Max level shown:
12025-04-30T06:29:30.082ZDEBGtest_image_create (init_with_steps): Running step start_crdb
22025-04-30T06:29:30.083ZDEBGtest_image_create: Starting CRDB
32025-04-30T06:29:30.115ZINFOtest_image_create: cockroach temporary directory: /var/tmp/omicron_tmp/.tmp1PDvx5
42025-04-30T06:29:30.116ZINFOtest_image_create: cockroach: copying from seed tarball (/var/tmp/omicron_tmp/crdb-base-build/f234518892194a05ad8767dc97f01a61a55baf1431942a314ce8b0f72b18ec2e.tar) to storage directory (/var/tmp/omicron_tmp/.tmp1PDvx5/data)
52025-04-30T06:29:30.138ZINFOtest_image_create: cockroach command line: cockroach start-single-node --insecure --http-addr=:0 --store=path=/var/tmp/omicron_tmp/.tmp1PDvx5/data,ballast-size=0 --listen-addr [::1]:0 --listening-url-file /var/tmp/omicron_tmp/.tmp1PDvx5/listen-url
62025-04-30T06:29:30.138ZINFOtest_image_create: cockroach environment: BUILDOMAT_JOB_ID=01JT2JWKGHF3JHFMW0JR13NSA6 BUILDOMAT_TASK_ID=4 CARGO=/home/build/.rustup/toolchains/1.86.0-x86_64-unknown-illumos/bin/cargo CARGO_HOME=/home/build/.cargo CARGO_INCREMENTAL=0 CARGO_MANIFEST_DIR=/work/oxidecomputer/omicron/nexus CARGO_PKG_AUTHORS= CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_LICENSE=MPL-2.0 CARGO_PKG_LICENSE_FILE= CARGO_PKG_NAME=omicron-nexus CARGO_PKG_REPOSITORY= CARGO_PKG_RUST_VERSION= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= CARGO_TERM_COLOR=always CI=true CRDB_SEED_TAR=/var/tmp/omicron_tmp/crdb-base-build/f234518892194a05ad8767dc97f01a61a55baf1431942a314ce8b0f72b18ec2e.tar GITHUB_REPOSITORY=oxidecomputer/omicron GITHUB_SHA=531912b3fc900900bc7bd18f5eac1ce1e22cb1cd GOTRACEBACK=crash HOME=/home/build LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-6532f52db341a7cc/out/build/artifacts:/work/oxidecomputer/omicron/target/debug/build/blake3-403ee89fc24db8f8/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-aece66bfb5c8df92/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-5fe90ecb72e1690f/out/build:/work/oxidecomputer/omicron/target/debug/build/ring-fb368fe91b2bd145/out:/work/oxidecomputer/omicron/target/debug/build/tofino-ffe28f7f2301d0c2/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-a7fb19a1e17b70f6/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.86.0-x86_64-unknown-illumos/lib/rustlib/x86_64-unknown-illumos/lib:/home/build/.rustup/toolchains/1.86.0-x86_64-unknown-illumos/lib LOGNAME=build NEXTEST=1 NEXTEST_BIN_EXE_nexus=/work/oxidecomputer/omicron/target/debug/nexus NEXTEST_BIN_EXE_schema-updater=/work/oxidecomputer/omicron/target/debug/schema-updater NEXTEST_EXECUTION_MODE=process-per-test NEXTEST_LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-6532f52db341a7cc/out/build/artifacts:/work/oxidecomputer/omicron/target/debug/build/blake3-403ee89fc24db8f8/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-aece66bfb5c8df92/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-5fe90ecb72e1690f/out/build:/work/oxidecomputer/omicron/target/debug/build/ring-fb368fe91b2bd145/out:/work/oxidecomputer/omicron/target/debug/build/tofino-ffe28f7f2301d0c2/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-a7fb19a1e17b70f6/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.86.0-x86_64-unknown-illumos/lib/rustlib/x86_64-unknown-illumos/lib:/home/build/.rustup/toolchains/1.86.0-x86_64-unknown-illumos/lib NEXTEST_PROFILE=ci NEXTEST_RUN_ID=29735cc2-0883-4059-8ca2-1da53f01ede3 NEXTEST_TEST_GLOBAL_SLOT=6 NEXTEST_TEST_GROUP=@global NEXTEST_TEST_GROUP_SLOT=none OUT_DIR=/work/oxidecomputer/omicron/target/debug/build/omicron-nexus-553062f859dbbfa0/out PATH=/work/oxidecomputer/omicron/out/mgd/root/opt/oxide/mgd/bin:/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin PWD=/work/oxidecomputer/omicron RUSTC_BOOTSTRAP=1 RUSTDOCFLAGS=--document-private-items -D warnings RUSTFLAGS=-D warnings -C link-arg=-R/usr/platform/oxide/lib/amd64 RUSTUP_HOME=/home/build/.rustup RUSTUP_TOOLCHAIN=1.86.0-x86_64-unknown-illumos RUST_BACKTRACE=1 RUST_RECURSION_COUNT=1 SHLVL=1 SSL_CERT_DIR=/usr/ssl/certs SSL_CERT_FILE=/etc/ssl/cacert.pem TMPDIR=/var/tmp/omicron_tmp TZ=UTC USER=build _=/usr/bin/ptime __NEXTEST_ATTEMPT=1
72025-04-30T06:29:31.711ZINFOtest_image_create: cockroach pid: 22771
82025-04-30T06:29:31.711ZINFOtest_image_create: cockroach listen URL: postgresql://root@[::1]:35301/omicron?sslmode=disable
92025-04-30T06:29:31.712ZDEBGtest_image_create (init_with_steps): Running step start_clickhouse
102025-04-30T06:29:31.712ZDEBGtest_image_create: Starting Clickhouse
112025-04-30T06:29:32.391ZDEBGtest_image_create (init_with_steps): Running step start_gateway_switch0
122025-04-30T06:29:32.391ZDEBGtest_image_create: Starting Management Gateway
132025-04-30T06:29:32.514ZDEBGtest_image_create (init_with_steps): Running step start_dendrite_switch0
142025-04-30T06:29:32.514ZDEBGtest_image_create: Starting Dendrite for switch0
152025-04-30T06:29:32.550ZDEBGtest_image_create (init_with_steps): Running step start_mgd_switch0
162025-04-30T06:29:32.550ZDEBGtest_image_create: Starting mgd for switch0
172025-04-30T06:29:32.645ZDEBGtest_image_create: mgd port is 48880
182025-04-30T06:29:32.645ZDEBGtest_image_create (init_with_steps): Running step record_switch_dns
192025-04-30T06:29:32.646ZDEBGtest_image_create: Recording DNS for the switch zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 switch_location = switch0
202025-04-30T06:29:32.650ZDEBGtest_image_create (init_with_steps): Running step start_internal_dns
212025-04-30T06:29:32.650ZINFOtest_image_create (store): opening sled database path = /var/tmp/omicron_tmp/.tmpvv8GN3
222025-04-30T06:29:32.848ZINFOtest_image_create (store): pruning trees for generations newer than 0
232025-04-30T06:29:32.848ZINFOtest_image_create (store): pruning trees for generations older than 0 keep = 3
242025-04-30T06:29:32.848ZINFOtest_image_create (dns): DNS server bound to address kind = dns local_address = [::1]:54108
252025-04-30T06:29:32.850ZDEBGtest_image_create (http): registered endpoint kind = dns local_addr = [::1]:36192 method = GET path = /config versions = all
262025-04-30T06:29:32.850ZDEBGtest_image_create (http): registered endpoint kind = dns local_addr = [::1]:36192 method = PUT path = /config versions = all
272025-04-30T06:29:32.850ZINFOtest_image_create (http): listening kind = dns local_addr = [::1]:36192
282025-04-30T06:29:32.851ZDEBGtest_image_create (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:36192
292025-04-30T06:29:32.851ZDEBGtest_image_create (init_with_steps): Running step start_external_dns
302025-04-30T06:29:32.852ZINFOtest_image_create (store): opening sled database path = /var/tmp/omicron_tmp/.tmpqxYbx6
312025-04-30T06:29:32.872ZINFOtest_image_create (store): pruning trees for generations newer than 0
322025-04-30T06:29:32.872ZINFOtest_image_create (store): pruning trees for generations older than 0 keep = 3
332025-04-30T06:29:32.872ZINFOtest_image_create (dns): DNS server bound to address kind = dns local_address = [::1]:47718
342025-04-30T06:29:32.873ZDEBGtest_image_create (http): registered endpoint kind = dns local_addr = [::1]:59680 method = GET path = /config versions = all
352025-04-30T06:29:32.873ZDEBGtest_image_create (http): registered endpoint kind = dns local_addr = [::1]:59680 method = PUT path = /config versions = all
362025-04-30T06:29:32.917ZINFOtest_image_create (http): listening kind = dns local_addr = [::1]:59680
372025-04-30T06:29:32.918ZDEBGtest_image_create (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:59680
382025-04-30T06:29:32.919ZDEBGtest_image_create (init_with_steps): Running step start_nexus_internal
392025-04-30T06:29:32.919ZDEBGtest_image_create: Starting Nexus (internal API)
402025-04-30T06:29:32.920ZINFOtest_image_create: setting up nexus server
412025-04-30T06:29:32.932ZINFOtest_image_create (ServerContext): registering Oso class class = Action
422025-04-30T06:29:32.932ZINFOtest_image_create (ServerContext): registering Oso class class = AnyActor
432025-04-30T06:29:32.935ZINFOtest_image_create (ServerContext): registering Oso class class = AuthenticatedActor
442025-04-30T06:29:32.935ZINFOtest_image_create (ServerContext): registering Oso class class = BlueprintConfig
452025-04-30T06:29:32.935ZINFOtest_image_create (ServerContext): registering Oso class class = Database
462025-04-30T06:29:32.935ZINFOtest_image_create (ServerContext): registering Oso class class = DnsConfig
472025-04-30T06:29:32.935ZINFOtest_image_create (ServerContext): registering Oso class class = Fleet
482025-04-30T06:29:32.935ZINFOtest_image_create (ServerContext): registering Oso class class = Inventory
492025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = IpPoolList
502025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = ConsoleSessionList
512025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = DeviceAuthRequestList
522025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = SiloCertificateList
532025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = SiloIdentityProviderList
542025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = SiloUserList
552025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = TargetReleaseConfig
562025-04-30T06:29:32.955ZINFOtest_image_create (ServerContext): registering Oso class class = WebhookEventClassList
572025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Project
582025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Disk
592025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Snapshot
602025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = ProjectImage
612025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = AffinityGroup
622025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = AntiAffinityGroup
632025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Instance
642025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = IpPool
652025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = InstanceNetworkInterface
662025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Vpc
672025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = VpcRouter
682025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = InternetGateway
692025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = InternetGatewayIpPool
702025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = InternetGatewayIpAddress
712025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = RouterRoute
722025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = VpcSubnet
732025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = FloatingIp
742025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Image
752025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = SiloImage
762025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = AddressLot
772025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Blueprint
782025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = LoopbackAddress
792025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Certificate
802025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = ConsoleSession
812025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = DeviceAuthRequest
822025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = DeviceAccessToken
832025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = PhysicalDisk
842025-04-30T06:29:32.956ZINFOtest_image_create (ServerContext): registering Oso class class = Rack
852025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = RoleBuiltin
862025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = SshKey
872025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = Silo
882025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = SiloUser
892025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = SiloGroup
902025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = SupportBundle
912025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = IdentityProvider
922025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = SamlIdentityProvider
932025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = Sled
942025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = TufRepo
952025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = TufArtifact
962025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = WebhookEvent
972025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = WebhookReceiver
982025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = WebhookSecret
992025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = Zpool
1002025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = Service
1012025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): registering Oso class class = UserBuiltin
1022025-04-30T06:29:32.957ZINFOtest_image_create (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\nresource WebhookSecret {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_webhook_receiver: WebhookReceiver };\n\n\t"read" if "read" on "parent_webhook_receiver";\n\t"modify" if "modify" on "parent_webhook_receiver";\n}\n\nhas_relation(rx: WebhookReceiver, "parent_webhook_receiver", secret: WebhookSecret)\n\tif secret.webhook_receiver = rx;\n\nresource WebhookEventClassList {\n\tpermissions = [ "list_children" ];\n\trelations = { parent_fleet: Fleet };\n\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", collection: WebhookEventClassList)\n\tif collection.fleet = fleet;\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource WebhookEvent {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: WebhookEvent)\n if child.fleet = fleet;\n \n\n resource WebhookReceiver {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: WebhookReceiver)\n if child.fleet = fleet;\n \n\n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n
1032025-04-30T06:29:33.071ZINFOtest_image_create (ServerContext): Setting up resolver using DNS address: [::1]:54108
1042025-04-30T06:29:33.071ZINFOtest_image_create (DnsResolver): new DNS resolver addresses = [[::1]:54108]
1052025-04-30T06:29:33.071ZINFOtest_image_create (ServerContext): Setting up qorb database pool from a single host url = PostgresConfigWithUrl {\n url_raw: "postgresql://root@[::1]:35301/omicron?sslmode=disable",\n config: Config {\n user: Some(\n "root",\n ),\n password: None,\n dbname: Some(\n "omicron",\n ),\n options: None,\n application_name: None,\n ssl_mode: Disable,\n host: [\n Tcp(\n "::1",\n ),\n ],\n hostaddr: [],\n port: [\n 35301,\n ],\n connect_timeout: None,\n tcp_user_timeout: None,\n keepalives: true,\n keepalives_idle: 7200s,\n keepalives_interval: None,\n keepalives_retries: None,\n target_session_attrs: Any,\n channel_binding: Prefer,\n load_balance_hosts: Disable,\n },\n}
1062025-04-30T06:29:33.073ZDEBGtest_image_create (ServerContext): registered USDT probes
1072025-04-30T06:29:33.168ZINFOtest_image_create (nexus): Database schema version is up to date desired_version = 140.0.0 found_version = 140.0.0
1082025-04-30T06:29:33.264ZDEBGtest_image_create (clickhouse-client): registered USDT probes id = 79b75cef-d694-4a74-9a97-582c2b9d75d5
1092025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /bgtasks versions = all
1102025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /bgtasks/activate versions = all
1112025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /bgtasks/view/{bgtask_name} versions = all
1122025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /clickhouse/policy versions = all
1132025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /clickhouse/policy versions = all
1142025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
1152025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
1162025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
1172025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1182025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1192025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /demo-saga versions = all
1202025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1212025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /deployment/blueprints/all versions = all
1222025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1232025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1242025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /deployment/blueprints/import versions = all
1252025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /deployment/blueprints/regenerate versions = all
1262025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /deployment/blueprints/target versions = all
1272025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /deployment/blueprints/target versions = all
1282025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = PUT path = /deployment/blueprints/target/enabled versions = all
1292025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1302025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = PUT path = /disks/{disk_id} versions = all
1312025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /experimental/v1/system/support-bundles versions = all
1322025-04-30T06:29:33.365ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /experimental/v1/system/support-bundles versions = all
1332025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
1342025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
1352025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
1362025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
1372025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
1382025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
1392025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
1402025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /instances/{instance_id}/migrate versions = all
1412025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /metrics/collectors versions = all
1422025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1432025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /metrics/producers versions = all
1442025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /mgs-updates versions = all
1452025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1462025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /oximeter/read-policy versions = all
1472025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /oximeter/read-policy versions = all
1482025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /physical-disk/expunge versions = all
1492025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /probes/{sled} versions = all
1502025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1512025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /sagas versions = all
1522025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /sagas/{saga_id} versions = all
1532025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /sled-agents/{sled_id} versions = all
1542025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /sled-agents/{sled_id} versions = all
1552025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1562025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /sleds/add versions = all
1572025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /sleds/expunge versions = all
1582025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /sleds/uninitialized versions = all
1592025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = PUT path = /switch/{switch_id} versions = all
1602025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = GET path = /v1/ping versions = all
1612025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = PUT path = /vmms/{propolis_id} versions = all
1622025-04-30T06:29:33.366ZDEBGtest_image_create (dropshot_internal): registered endpoint local_addr = 127.0.0.1:35774 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1632025-04-30T06:29:33.367ZINFOtest_image_create (dropshot_internal): listening local_addr = 127.0.0.1:35774
1642025-04-30T06:29:33.367ZDEBGtest_image_create (dropshot_internal): successfully registered DTrace USDT probes local_addr = 127.0.0.1:35774
1652025-04-30T06:29:33.367ZINFOtest_image_create (SEC): SEC running sec_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
1662025-04-30T06:29:33.368ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1672025-04-30T06:29:33.368ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
1682025-04-30T06:29:33.371ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692025-04-30T06:29:33.371ZDEBGtest_image_create (DataLoader): attempting to create built-in users
1702025-04-30T06:29:33.373ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1712025-04-30T06:29:33.373ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
1722025-04-30T06:29:33.373ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732025-04-30T06:29:33.375ZINFOtest_image_create (MgsUpdateDriver): starting MgsUpdateDriver
1742025-04-30T06:29:33.381ZTRACtest_image_create (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: 16 48 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 .H..........._cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:54680 req_id = 50186c12-ec10-45fb-a6aa-6cc22ccb32bc
1752025-04-30T06:29:33.381ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 5704,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54680 req_id = 50186c12-ec10-45fb-a6aa-6cc22ccb32bc
1762025-04-30T06:29:33.383ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5704, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_crucible-pantry._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 16, 95, 99, 114, 117, 99, 105, 98, 108, 101, 45, 112, 97, 110, 116, 114, 121, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } SERVFAIL: server is not authoritative for name: "_crucible-pantry._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:54680 req_id = 50186c12-ec10-45fb-a6aa-6cc22ccb32bc
1772025-04-30T06:29:33.428ZINFOtest_image_create (DataLoader): created 5 built-in users
1782025-04-30T06:29:33.428ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1792025-04-30T06:29:33.428ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
1802025-04-30T06:29:33.431ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812025-04-30T06:29:33.431ZDEBGtest_image_create (DataLoader): attempting to create built-in roles
1822025-04-30T06:29:33.431ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1832025-04-30T06:29:33.431ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
1842025-04-30T06:29:33.432ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852025-04-30T06:29:33.529ZINFOtest_image_create (DataLoader): created 10 built-in roles
1862025-04-30T06:29:33.529ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1872025-04-30T06:29:33.529ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
1882025-04-30T06:29:33.537ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892025-04-30T06:29:33.538ZDEBGtest_image_create (DataLoader): attempting to create built-in role assignments
1902025-04-30T06:29:33.538ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1912025-04-30T06:29:33.538ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
1922025-04-30T06:29:33.540ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1932025-04-30T06:29:34.004ZINFOtest_image_create (DataLoader): created 4 built-in role assignments
1942025-04-30T06:29:34.004ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1952025-04-30T06:29:34.004ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
1962025-04-30T06:29:34.007ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972025-04-30T06:29:34.007ZDEBGtest_image_create (DataLoader): attempting to create built-in silos
1982025-04-30T06:29:34.007ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
1992025-04-30T06:29:34.007ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2002025-04-30T06:29:34.007ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012025-04-30T06:29:34.130ZINFOtest_image_create (DataLoader): created 2 built-in silos
2022025-04-30T06:29:34.130ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2032025-04-30T06:29:34.130ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2042025-04-30T06:29:34.131ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052025-04-30T06:29:34.145ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2062025-04-30T06:29:34.145ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2072025-04-30T06:29:34.148ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082025-04-30T06:29:34.148ZDEBGtest_image_create (DataLoader): attempting to create built-in projects
2092025-04-30T06:29:34.148ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2102025-04-30T06:29:34.148ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2112025-04-30T06:29:34.149ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122025-04-30T06:29:34.160ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2132025-04-30T06:29:34.160ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2142025-04-30T06:29:34.160ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2152025-04-30T06:29:34.160ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2162025-04-30T06:29:34.161ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172025-04-30T06:29:34.223ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2182025-04-30T06:29:34.223ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2192025-04-30T06:29:34.223ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2202025-04-30T06:29:34.223ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212025-04-30T06:29:34.229ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2222025-04-30T06:29:34.232ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2232025-04-30T06:29:34.233ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2242025-04-30T06:29:34.233ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2252025-04-30T06:29:34.233ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2262025-04-30T06:29:34.233ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2272025-04-30T06:29:34.233ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282025-04-30T06:29:34.236ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2292025-04-30T06:29:34.236ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2302025-04-30T06:29:34.236ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2312025-04-30T06:29:34.236ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322025-04-30T06:29:34.240ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2332025-04-30T06:29:34.243ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2342025-04-30T06:29:34.243ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2352025-04-30T06:29:34.243ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2362025-04-30T06:29:34.243ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372025-04-30T06:29:34.264ZINFOtest_image_create (DataLoader): created built-in services project
2382025-04-30T06:29:34.264ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2392025-04-30T06:29:34.264ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2402025-04-30T06:29:34.266ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412025-04-30T06:29:34.267ZDEBGtest_image_create (DataLoader): attempting to create built-in VPCs
2422025-04-30T06:29:34.267ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2432025-04-30T06:29:34.267ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2442025-04-30T06:29:34.267ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452025-04-30T06:29:34.270ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2462025-04-30T06:29:34.270ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2472025-04-30T06:29:34.271ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482025-04-30T06:29:34.273ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2492025-04-30T06:29:34.274ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2502025-04-30T06:29:34.274ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2512025-04-30T06:29:34.274ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2522025-04-30T06:29:34.274ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532025-04-30T06:29:34.276ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2542025-04-30T06:29:34.276ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2552025-04-30T06:29:34.276ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2562025-04-30T06:29:34.277ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572025-04-30T06:29:34.278ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2582025-04-30T06:29:34.278ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2592025-04-30T06:29:34.278ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2602025-04-30T06:29:34.279ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612025-04-30T06:29:34.281ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2622025-04-30T06:29:34.286ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2632025-04-30T06:29:34.286ZTRACtest_image_create (DataLoader): successful lookup of siloed resource "Project" using built-in user
2642025-04-30T06:29:34.286ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2652025-04-30T06:29:34.286ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2662025-04-30T06:29:34.286ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2672025-04-30T06:29:34.286ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2682025-04-30T06:29:34.287ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692025-04-30T06:29:34.289ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2702025-04-30T06:29:34.290ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2712025-04-30T06:29:34.290ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2722025-04-30T06:29:34.291ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732025-04-30T06:29:34.301ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2742025-04-30T06:29:34.301ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2752025-04-30T06:29:34.301ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2762025-04-30T06:29:34.303ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772025-04-30T06:29:34.305ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2782025-04-30T06:29:34.312ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2792025-04-30T06:29:34.312ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2802025-04-30T06:29:34.312ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2812025-04-30T06:29:34.313ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822025-04-30T06:29:34.328ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
2832025-04-30T06:29:34.328ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2842025-04-30T06:29:34.328ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2852025-04-30T06:29:34.328ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2862025-04-30T06:29:34.329ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2872025-04-30T06:29:34.331ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2882025-04-30T06:29:34.332ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2892025-04-30T06:29:34.332ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2902025-04-30T06:29:34.332ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2912025-04-30T06:29:34.334ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2922025-04-30T06:29:34.334ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2932025-04-30T06:29:34.334ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2942025-04-30T06:29:34.335ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2952025-04-30T06:29:34.338ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2962025-04-30T06:29:34.347ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2972025-04-30T06:29:34.348ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
2982025-04-30T06:29:34.348ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
2992025-04-30T06:29:34.348ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002025-04-30T06:29:34.355ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3012025-04-30T06:29:34.356ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3022025-04-30T06:29:34.356ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032025-04-30T06:29:34.366ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3042025-04-30T06:29:34.366ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3052025-04-30T06:29:34.367ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062025-04-30T06:29:34.383ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
3072025-04-30T06:29:34.384ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3082025-04-30T06:29:34.384ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3092025-04-30T06:29:34.384ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3102025-04-30T06:29:34.389ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112025-04-30T06:29:34.393ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3122025-04-30T06:29:34.394ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3132025-04-30T06:29:34.394ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3142025-04-30T06:29:34.395ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152025-04-30T06:29:34.427ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3162025-04-30T06:29:34.427ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3172025-04-30T06:29:34.427ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3182025-04-30T06:29:34.428ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192025-04-30T06:29:34.445ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3202025-04-30T06:29:34.465ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
3212025-04-30T06:29:34.465ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3222025-04-30T06:29:34.465ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3232025-04-30T06:29:34.466ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242025-04-30T06:29:34.538ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3252025-04-30T06:29:34.538ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3262025-04-30T06:29:34.538ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3272025-04-30T06:29:34.538ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3282025-04-30T06:29:34.540ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292025-04-30T06:29:34.546ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3302025-04-30T06:29:34.547ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3312025-04-30T06:29:34.547ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3322025-04-30T06:29:34.547ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332025-04-30T06:29:34.556ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3342025-04-30T06:29:34.556ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3352025-04-30T06:29:34.556ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3362025-04-30T06:29:34.557ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372025-04-30T06:29:34.561ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3382025-04-30T06:29:34.571ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3392025-04-30T06:29:34.572ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3402025-04-30T06:29:34.572ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3412025-04-30T06:29:34.572ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422025-04-30T06:29:34.652ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3432025-04-30T06:29:34.652ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3442025-04-30T06:29:34.652ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3452025-04-30T06:29:34.652ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3462025-04-30T06:29:34.655ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472025-04-30T06:29:34.658ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3482025-04-30T06:29:34.658ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3492025-04-30T06:29:34.658ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3502025-04-30T06:29:34.659ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3512025-04-30T06:29:34.661ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3522025-04-30T06:29:34.661ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3532025-04-30T06:29:34.661ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3542025-04-30T06:29:34.662ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552025-04-30T06:29:34.664ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3562025-04-30T06:29:34.670ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3572025-04-30T06:29:34.670ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3582025-04-30T06:29:34.670ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3592025-04-30T06:29:34.670ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602025-04-30T06:29:34.678ZDEBGtest_image_create (DataLoader): attempting to create built-in VPC firewall rules
3612025-04-30T06:29:34.678ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3622025-04-30T06:29:34.678ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3632025-04-30T06:29:34.687ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642025-04-30T06:29:34.690ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3652025-04-30T06:29:34.690ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3662025-04-30T06:29:34.690ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672025-04-30T06:29:34.692ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3682025-04-30T06:29:34.692ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3692025-04-30T06:29:34.693ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702025-04-30T06:29:34.696ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
3712025-04-30T06:29:34.696ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3722025-04-30T06:29:34.696ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3732025-04-30T06:29:34.696ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3742025-04-30T06:29:34.697ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3752025-04-30T06:29:34.698ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3762025-04-30T06:29:34.699ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3772025-04-30T06:29:34.699ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3782025-04-30T06:29:34.699ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3792025-04-30T06:29:34.701ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3802025-04-30T06:29:34.701ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3812025-04-30T06:29:34.701ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3822025-04-30T06:29:34.701ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3832025-04-30T06:29:34.703ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3842025-04-30T06:29:34.709ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3852025-04-30T06:29:34.709ZTRACtest_image_create (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
3862025-04-30T06:29:34.709ZTRACtest_image_create (DataLoader): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
3872025-04-30T06:29:34.709ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3882025-04-30T06:29:34.710ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3892025-04-30T06:29:34.710ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3902025-04-30T06:29:34.710ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3912025-04-30T06:29:34.712ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3922025-04-30T06:29:34.712ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3932025-04-30T06:29:34.713ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3942025-04-30T06:29:34.714ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952025-04-30T06:29:34.717ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3962025-04-30T06:29:34.717ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
3972025-04-30T06:29:34.717ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
3982025-04-30T06:29:34.718ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3992025-04-30T06:29:34.720ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4002025-04-30T06:29:34.728ZDEBGtest_image_create (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4012025-04-30T06:29:34.728ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4022025-04-30T06:29:34.728ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4032025-04-30T06:29:34.728ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4042025-04-30T06:29:34.741ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4052025-04-30T06:29:34.741ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4062025-04-30T06:29:34.741ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4072025-04-30T06:29:34.741ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4082025-04-30T06:29:34.741ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4092025-04-30T06:29:34.744ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4102025-04-30T06:29:34.744ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4112025-04-30T06:29:34.745ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4122025-04-30T06:29:34.746ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4132025-04-30T06:29:34.750ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4142025-04-30T06:29:34.751ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4152025-04-30T06:29:34.751ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4162025-04-30T06:29:34.751ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4172025-04-30T06:29:34.753ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4182025-04-30T06:29:34.759ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4192025-04-30T06:29:34.759ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4202025-04-30T06:29:34.759ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4212025-04-30T06:29:34.760ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4222025-04-30T06:29:34.846ZINFOtest_image_create (DataLoader): created built-in VPC firewall rules
4232025-04-30T06:29:34.846ZDEBGtest_image_create (DataLoader): attempting to create built-in VPC Subnets
4242025-04-30T06:29:34.846ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4252025-04-30T06:29:34.846ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4262025-04-30T06:29:34.848ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4272025-04-30T06:29:34.851ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4282025-04-30T06:29:34.851ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4292025-04-30T06:29:34.852ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4302025-04-30T06:29:34.857ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4312025-04-30T06:29:34.857ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4322025-04-30T06:29:34.859ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4332025-04-30T06:29:34.861ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4342025-04-30T06:29:34.861ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4352025-04-30T06:29:34.861ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4362025-04-30T06:29:34.861ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4372025-04-30T06:29:34.862ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4382025-04-30T06:29:34.871ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4392025-04-30T06:29:34.871ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4402025-04-30T06:29:34.871ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4412025-04-30T06:29:34.872ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4422025-04-30T06:29:34.889ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4432025-04-30T06:29:34.889ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4442025-04-30T06:29:34.889ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4452025-04-30T06:29:34.890ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4462025-04-30T06:29:34.893ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4472025-04-30T06:29:34.899ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4482025-04-30T06:29:34.899ZTRACtest_image_create (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
4492025-04-30T06:29:34.899ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4502025-04-30T06:29:34.899ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4512025-04-30T06:29:34.899ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4522025-04-30T06:29:34.907ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4532025-04-30T06:29:34.907ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4542025-04-30T06:29:34.907ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4552025-04-30T06:29:34.907ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4562025-04-30T06:29:34.907ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4572025-04-30T06:29:34.910ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4582025-04-30T06:29:34.910ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4592025-04-30T06:29:34.910ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4602025-04-30T06:29:34.910ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4612025-04-30T06:29:34.921ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4622025-04-30T06:29:34.921ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4632025-04-30T06:29:34.923ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4642025-04-30T06:29:34.924ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4652025-04-30T06:29:34.934ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4662025-04-30T06:29:34.941ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4672025-04-30T06:29:34.961ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
4682025-04-30T06:29:34.962ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4692025-04-30T06:29:34.962ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4702025-04-30T06:29:34.962ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4712025-04-30T06:29:34.965ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4722025-04-30T06:29:34.970ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4732025-04-30T06:29:34.971ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4742025-04-30T06:29:34.971ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4752025-04-30T06:29:34.971ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4762025-04-30T06:29:34.977ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4772025-04-30T06:29:34.977ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4782025-04-30T06:29:34.977ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4792025-04-30T06:29:34.977ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4802025-04-30T06:29:34.981ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4812025-04-30T06:29:34.990ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
4822025-04-30T06:29:34.990ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4832025-04-30T06:29:34.990ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4842025-04-30T06:29:34.990ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4852025-04-30T06:29:35.041ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4862025-04-30T06:29:35.041ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4872025-04-30T06:29:35.042ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4882025-04-30T06:29:35.050ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4892025-04-30T06:29:35.050ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4902025-04-30T06:29:35.050ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4912025-04-30T06:29:35.050ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4922025-04-30T06:29:35.051ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4932025-04-30T06:29:35.065ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4942025-04-30T06:29:35.065ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4952025-04-30T06:29:35.065ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
4962025-04-30T06:29:35.066ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4972025-04-30T06:29:35.070ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4982025-04-30T06:29:35.071ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
4992025-04-30T06:29:35.071ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5002025-04-30T06:29:35.072ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5012025-04-30T06:29:35.078ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5022025-04-30T06:29:35.085ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5032025-04-30T06:29:35.092ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5042025-04-30T06:29:35.092ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5052025-04-30T06:29:35.092ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5062025-04-30T06:29:35.092ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5072025-04-30T06:29:35.093ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5082025-04-30T06:29:35.098ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5092025-04-30T06:29:35.098ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5102025-04-30T06:29:35.098ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5112025-04-30T06:29:35.099ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5122025-04-30T06:29:35.101ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5132025-04-30T06:29:35.102ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5142025-04-30T06:29:35.102ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5152025-04-30T06:29:35.102ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5162025-04-30T06:29:35.105ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5172025-04-30T06:29:35.113ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5182025-04-30T06:29:35.113ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5192025-04-30T06:29:35.113ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5202025-04-30T06:29:35.114ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5212025-04-30T06:29:35.120ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5222025-04-30T06:29:35.120ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5232025-04-30T06:29:35.121ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5242025-04-30T06:29:35.125ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
5252025-04-30T06:29:35.127ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5262025-04-30T06:29:35.128ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5272025-04-30T06:29:35.128ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5282025-04-30T06:29:35.128ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5292025-04-30T06:29:35.132ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5302025-04-30T06:29:35.132ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5312025-04-30T06:29:35.133ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5322025-04-30T06:29:35.134ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5332025-04-30T06:29:35.140ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5342025-04-30T06:29:35.140ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5352025-04-30T06:29:35.140ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5362025-04-30T06:29:35.141ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5372025-04-30T06:29:35.145ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5382025-04-30T06:29:35.152ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5392025-04-30T06:29:35.158ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5402025-04-30T06:29:35.158ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5412025-04-30T06:29:35.158ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5422025-04-30T06:29:35.158ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5432025-04-30T06:29:35.159ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5442025-04-30T06:29:35.161ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5452025-04-30T06:29:35.161ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5462025-04-30T06:29:35.161ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5472025-04-30T06:29:35.162ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5482025-04-30T06:29:35.165ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5492025-04-30T06:29:35.165ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5502025-04-30T06:29:35.166ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5512025-04-30T06:29:35.166ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5522025-04-30T06:29:35.169ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5532025-04-30T06:29:35.178ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5542025-04-30T06:29:35.178ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5552025-04-30T06:29:35.178ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5562025-04-30T06:29:35.179ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5572025-04-30T06:29:35.188ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5582025-04-30T06:29:35.188ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5592025-04-30T06:29:35.189ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5602025-04-30T06:29:35.199ZINFOtest_image_create (DataLoader): created built-in services vpc subnets
5612025-04-30T06:29:35.199ZINFOtest_image_create (DataLoader): created built-in services vpc
5622025-04-30T06:29:35.199ZTRACtest_image_create (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5632025-04-30T06:29:35.199ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5642025-04-30T06:29:35.201ZDEBGtest_image_create (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5652025-04-30T06:29:35.202ZDEBGtest_image_create (DataLoader): attempting to create silo users
5662025-04-30T06:29:35.202ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5672025-04-30T06:29:35.202ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5682025-04-30T06:29:35.202ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5692025-04-30T06:29:35.213ZINFOtest_image_create (DataLoader): created 2 silo users
5702025-04-30T06:29:35.213ZDEBGtest_image_create (DataLoader): attempting to create silo user role assignments
5712025-04-30T06:29:35.213ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5722025-04-30T06:29:35.213ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5732025-04-30T06:29:35.214ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5742025-04-30T06:29:35.219ZINFOtest_image_create (DataLoader): created 2 silo user role assignments
5752025-04-30T06:29:35.219ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5762025-04-30T06:29:35.220ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5772025-04-30T06:29:35.220ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5782025-04-30T06:29:35.227ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5792025-04-30T06:29:35.227ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5802025-04-30T06:29:35.228ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5812025-04-30T06:29:35.238ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList
5822025-04-30T06:29:35.238ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5832025-04-30T06:29:35.238ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5842025-04-30T06:29:35.238ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5852025-04-30T06:29:35.239ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5862025-04-30T06:29:35.241ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5872025-04-30T06:29:35.244ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
5882025-04-30T06:29:35.244ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5892025-04-30T06:29:35.244ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5902025-04-30T06:29:35.245ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5912025-04-30T06:29:35.254ZTRACtest_image_create (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList
5922025-04-30T06:29:35.254ZTRACtest_image_create (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5932025-04-30T06:29:35.254ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5942025-04-30T06:29:35.254ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5952025-04-30T06:29:35.254ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
5962025-04-30T06:29:35.256ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
5972025-04-30T06:29:35.261ZDEBGtest_image_create (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
5982025-04-30T06:29:35.261ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
5992025-04-30T06:29:35.261ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
6002025-04-30T06:29:35.262ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
6012025-04-30T06:29:35.322ZTRACtest_image_create (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database
6022025-04-30T06:29:35.323ZDEBGtest_image_create (DataLoader): roles roles = RoleSet { roles: {} }
6032025-04-30T06:29:35.323ZDEBGtest_image_create (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
6042025-04-30T06:29:35.331ZINFOtest_image_create (nexus): populate complete
6052025-04-30T06:29:35.331ZINFOtest_image_create (nexus): activating background tasks
6062025-04-30T06:29:35.335ZDEBGtest_image_create (init_with_steps): Running step start_sled1
6072025-04-30T06:29:35.335ZINFOtest_image_create (omicron_sled_agent::sim::Server): setting up sled agent server sled_id = b6d65341-167c-41df-9b5c-41cded99c229
6082025-04-30T06:29:35.386ZINFOtest_image_create (SledAgent): created simulated sled agent server = b6d65341-167c-41df-9b5c-41cded99c229 sim_mode = Explicit sled_id = b6d65341-167c-41df-9b5c-41cded99c229
6092025-04-30T06:29:35.387ZINFOtest_image_create (omicron_sled_agent::sim::SimulatedUpstairs): registered sled b6d65341-167c-41df-9b5c-41cded99c229 storage
6102025-04-30T06:29:35.387ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
6112025-04-30T06:29:35.387ZDEBGtest_image_create (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6122025-04-30T06:29:35.387ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
6132025-04-30T06:29:35.387ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6142025-04-30T06:29:35.388ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6152025-04-30T06:29:35.388ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
6162025-04-30T06:29:35.388ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
6172025-04-30T06:29:35.389ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
6182025-04-30T06:29:35.389ZWARNtest_image_create (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config nor servers
6192025-04-30T06:29:35.389ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 123.446\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6202025-04-30T06:29:35.389ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
6212025-04-30T06:29:35.389ZDEBGtest_image_create (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6222025-04-30T06:29:35.389ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
6232025-04-30T06:29:35.389ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6242025-04-30T06:29:35.390ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6252025-04-30T06:29:35.390ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
6262025-04-30T06:29:35.390ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
6272025-04-30T06:29:35.391ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
6282025-04-30T06:29:35.391ZWARNtest_image_create (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config nor servers
6292025-04-30T06:29:35.391ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 46.673\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6302025-04-30T06:29:35.391ZDEBGtest_image_create (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
6312025-04-30T06:29:35.391ZINFOtest_image_create (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-04-30 06:19:35.391126393 UTC
6322025-04-30T06:29:35.391ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database
6332025-04-30T06:29:35.391ZDEBGtest_image_create (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6342025-04-30T06:29:35.392ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6352025-04-30T06:29:35.393ZDEBGtest_image_create (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
6362025-04-30T06:29:35.393ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet
6372025-04-30T06:29:35.393ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6382025-04-30T06:29:35.393ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
6392025-04-30T06:29:35.393ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6402025-04-30T06:29:35.393ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6412025-04-30T06:29:35.394ZDEBGtest_image_create (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
6422025-04-30T06:29:35.394ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database
6432025-04-30T06:29:35.394ZDEBGtest_image_create (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6442025-04-30T06:29:35.394ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6452025-04-30T06:29:35.394ZDEBGtest_image_create (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
6462025-04-30T06:29:35.394ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database
6472025-04-30T06:29:35.394ZDEBGtest_image_create (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6482025-04-30T06:29:35.394ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6492025-04-30T06:29:35.395ZDEBGtest_image_create (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
6502025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
6512025-04-30T06:29:35.396ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig
6522025-04-30T06:29:35.396ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6532025-04-30T06:29:35.396ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database
6542025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6552025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6562025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
6572025-04-30T06:29:35.396ZWARNtest_image_create (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor reason = no blueprint
6582025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 54.85\u{b5}s iteration = 1 status = {"error":"no blueprint"}
6592025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
6602025-04-30T06:29:35.396ZWARNtest_image_create (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector reason = no blueprint
6612025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 16.332\u{b5}s iteration = 1 status = {"error":"no blueprint"}
6622025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
6632025-04-30T06:29:35.396ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
6642025-04-30T06:29:35.396ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6652025-04-30T06:29:35.396ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
6662025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6672025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6682025-04-30T06:29:35.396ZDEBGtest_image_create (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
6692025-04-30T06:29:35.397ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet
6702025-04-30T06:29:35.397ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6712025-04-30T06:29:35.397ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database
6722025-04-30T06:29:35.397ZDEBGtest_image_create (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6732025-04-30T06:29:35.403ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6742025-04-30T06:29:35.403ZDEBGtest_image_create (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
6752025-04-30T06:29:35.403ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 37.004\u{b5}s iteration = 1 status = {"error":"task disabled"}
6762025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
6772025-04-30T06:29:35.404ZWARNtest_image_create (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous reason = no blueprint
6782025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 42.855\u{b5}s iteration = 1 status = {"error":"no blueprint"}
6792025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
6802025-04-30T06:29:35.404ZINFOtest_image_create (BackgroundTasks): Decommissioned Disk Cleaner disabled background_task = decommissioned_disk_cleaner
6812025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.136\u{b5}s iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6822025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
6832025-04-30T06:29:35.404ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory
6842025-04-30T06:29:35.404ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_zone_nat_tracker resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6852025-04-30T06:29:35.404ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database
6862025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6872025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6882025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
6892025-04-30T06:29:35.404ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet
6902025-04-30T06:29:35.404ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = switch_port_config_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6912025-04-30T06:29:35.404ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database
6922025-04-30T06:29:35.404ZDEBGtest_image_create (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6932025-04-30T06:29:35.405ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6942025-04-30T06:29:35.405ZDEBGtest_image_create (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
6952025-04-30T06:29:35.406ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
6962025-04-30T06:29:35.406ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6972025-04-30T06:29:35.406ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6982025-04-30T06:29:35.407ZDEBGtest_image_create (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
6992025-04-30T06:29:35.407ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database
7002025-04-30T06:29:35.407ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7012025-04-30T06:29:35.407ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7022025-04-30T06:29:35.407ZDEBGtest_image_create (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
7032025-04-30T06:29:35.407ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database
7042025-04-30T06:29:35.407ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7052025-04-30T06:29:35.408ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7062025-04-30T06:29:35.408ZDEBGtest_image_create (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
7072025-04-30T06:29:35.408ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet
7082025-04-30T06:29:35.408ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = instance_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7092025-04-30T06:29:35.408ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database
7102025-04-30T06:29:35.408ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7112025-04-30T06:29:35.409ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7122025-04-30T06:29:35.409ZDEBGtest_image_create (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
7132025-04-30T06:29:35.409ZINFOtest_image_create (BackgroundTasks): background instance updater explicitly disabled background_task = instance_updater
7142025-04-30T06:29:35.409ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = instance_updater elapsed = 346.29\u{b5}s iteration = 1 status = {"destroyed_active_vmms":0,"disabled":true,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7152025-04-30T06:29:35.409ZDEBGtest_image_create (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
7162025-04-30T06:29:35.409ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database
7172025-04-30T06:29:35.409ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7182025-04-30T06:29:35.410ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7192025-04-30T06:29:35.410ZDEBGtest_image_create (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
7202025-04-30T06:29:35.410ZDEBGtest_image_create (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
7212025-04-30T06:29:35.410ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
7222025-04-30T06:29:35.410ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7232025-04-30T06:29:35.410ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7242025-04-30T06:29:35.411ZDEBGtest_image_create (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
7252025-04-30T06:29:35.411ZINFOtest_image_create (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
7262025-04-30T06:29:35.411ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet
7272025-04-30T06:29:35.411ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7282025-04-30T06:29:35.411ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
7292025-04-30T06:29:35.411ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7302025-04-30T06:29:35.411ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7312025-04-30T06:29:35.411ZDEBGtest_image_create (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
7322025-04-30T06:29:35.411ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database
7332025-04-30T06:29:35.411ZDEBGtest_image_create (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
7342025-04-30T06:29:35.412ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
7352025-04-30T06:29:35.412ZDEBGtest_image_create (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
7362025-04-30T06:29:35.412ZDEBGtest_image_create (SagaRecoverer): listing candidate sagas for recovery
7372025-04-30T06:29:35.412ZTRACtest_image_create (SagaRecoverer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database
7382025-04-30T06:29:35.412ZDEBGtest_image_create (SagaRecoverer): roles roles = RoleSet { roles: {} }
7392025-04-30T06:29:35.412ZDEBGtest_image_create (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
7402025-04-30T06:29:35.412ZDEBGtest_image_create (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
7412025-04-30T06:29:35.413ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database
7422025-04-30T06:29:35.413ZDEBGtest_image_create (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
7432025-04-30T06:29:35.413ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
7442025-04-30T06:29:35.413ZDEBGtest_image_create (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
7452025-04-30T06:29:35.413ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database
7462025-04-30T06:29:35.413ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7472025-04-30T06:29:35.414ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7482025-04-30T06:29:35.414ZDEBGtest_image_create (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
7492025-04-30T06:29:35.414ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database
7502025-04-30T06:29:35.414ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7512025-04-30T06:29:35.415ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7522025-04-30T06:29:35.415ZDEBGtest_image_create (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
7532025-04-30T06:29:35.415ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database
7542025-04-30T06:29:35.415ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7552025-04-30T06:29:35.416ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7562025-04-30T06:29:35.416ZDEBGtest_image_create (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
7572025-04-30T06:29:35.416ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database
7582025-04-30T06:29:35.416ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7592025-04-30T06:29:35.416ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7602025-04-30T06:29:35.416ZDEBGtest_image_create (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
7612025-04-30T06:29:35.416ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet
7622025-04-30T06:29:35.416ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7632025-04-30T06:29:35.416ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database
7642025-04-30T06:29:35.416ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7652025-04-30T06:29:35.417ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7662025-04-30T06:29:35.417ZDEBGtest_image_create (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 1 reason = Timeout
7672025-04-30T06:29:35.417ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database
7682025-04-30T06:29:35.417ZDEBGtest_image_create (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
7692025-04-30T06:29:35.417ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7702025-04-30T06:29:35.417ZDEBGtest_image_create (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 1 reason = Timeout
7712025-04-30T06:29:35.417ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database
7722025-04-30T06:29:35.418ZDEBGtest_image_create (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
7732025-04-30T06:29:35.418ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
7742025-04-30T06:29:35.418ZDEBGtest_image_create (BackgroundTasks): activating background_task = webhook_deliverator iteration = 1 reason = Timeout
7752025-04-30T06:29:35.418ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database
7762025-04-30T06:29:35.418ZDEBGtest_image_create (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
7772025-04-30T06:29:35.419ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
7782025-04-30T06:29:35.419ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
7792025-04-30T06:29:35.419ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7802025-04-30T06:29:35.419ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
7812025-04-30T06:29:35.419ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7822025-04-30T06:29:35.419ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7832025-04-30T06:29:35.420ZINFOtest_image_create (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpMxaQy9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
7842025-04-30T06:29:35.420ZDEBGtest_image_create (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpMxaQy9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
7852025-04-30T06:29:35.420ZINFOtest_image_create (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpHaOyf9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
7862025-04-30T06:29:35.420ZDEBGtest_image_create (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpHaOyf9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
7872025-04-30T06:29:35.562ZDEBGtest_image_create (dropshot (Repo Depot)): registered endpoint local_addr = [::1]:35864 method = GET path = /artifact/sha256/{sha256} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7882025-04-30T06:29:35.567ZINFOtest_image_create (dropshot (Repo Depot)): listening local_addr = [::1]:35864 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
7892025-04-30T06:29:35.573ZDEBGtest_image_create (dropshot (Repo Depot)): successfully registered DTrace USDT probes local_addr = [::1]:35864 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
7902025-04-30T06:29:35.590ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /artifacts sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7912025-04-30T06:29:35.590ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /artifacts/{sha256} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7922025-04-30T06:29:35.590ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /artifacts/{sha256}/copy-from-depot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7932025-04-30T06:29:35.590ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7942025-04-30T06:29:35.590ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7952025-04-30T06:29:35.590ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /boot-disk/{boot_disk}/os/write sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7962025-04-30T06:29:35.590ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /boot-disk/{boot_disk}/os/write/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7972025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = DELETE path = /boot-disk/{boot_disk}/os/write/status/{update_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7982025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /bootstore/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
7992025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /datasets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8002025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /disks/{disk_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8012025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /disks/{disk_id}/poke sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8022025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /eip-gateways sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8032025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8042025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8052025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8062025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8072025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /omicron-physical-disks sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8082025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /sled-identifiers sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8092025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /sled-role sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8102025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /sleds sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8112025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/dladm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8122025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/ipadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8132025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/logs/download/{zone} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8142025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/logs/zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8152025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/nvmeadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8162025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/pargs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8172025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/pfiles-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8182025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/pstack-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8192025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/zfs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8202025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/zoneadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8212025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support/zpool-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8222025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support-bundles/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8232025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = DELETE path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8242025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8252025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8262025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8272025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8282025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8292025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8302025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8312025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /switch-ports sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8322025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /timesync sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8332025-04-30T06:29:35.591ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = DELETE path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8342025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8352025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8362025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = DELETE path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8372025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8382025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /vmms/{propolis_id}/disks/{disk_id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8392025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = DELETE path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8402025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8412025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /vmms/{propolis_id}/poke sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8422025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /vmms/{propolis_id}/poke-single-step sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8432025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /vmms/{propolis_id}/sim-migration-source sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8442025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8452025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8462025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /vpc/{vpc_id}/firewall/rules sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8472025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8482025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8492025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8502025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = POST path = /zones/bundle-cleanup sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8512025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8522025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = PUT path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8532025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /zones/bundle-cleanup/utilization sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8542025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /zones/bundles sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8552025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /zones/bundles/{zone_name} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8562025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = DELETE path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8572025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8582025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:42828 method = GET path = /zpools sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
8592025-04-30T06:29:35.592ZINFOtest_image_create (dropshot): listening local_addr = [::1]:42828 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
8602025-04-30T06:29:35.592ZDEBGtest_image_create (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:42828 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
8612025-04-30T06:29:35.592ZDEBGtest_image_create (omicron_sled_agent::sim::Server): contacting server nexus sled_id = b6d65341-167c-41df-9b5c-41cded99c229
8622025-04-30T06:29:35.593ZDEBGtest_image_create (NexusClient): client request body = Some(Body) method = POST sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:35774/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
8632025-04-30T06:29:35.594ZTRACtest_image_create (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: 99 c9 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 ............._na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:64132 req_id = aa63908c-d257-4020-a79e-094ea4f46e29
8642025-04-30T06:29:35.594ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 39369,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64132 req_id = aa63908c-d257-4020-a79e-094ea4f46e29
8652025-04-30T06:29:35.595ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39369, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_nameservice._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 12, 95, 110, 97, 109, 101, 115, 101, 114, 118, 105, 99, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } SERVFAIL: server is not authoritative for name: "_nameservice._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:64132 req_id = aa63908c-d257-4020-a79e-094ea4f46e29
8662025-04-30T06:29:35.595ZTRACtest_image_create (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: f7 57 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 .W..........._ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:49304 req_id = 86acfdec-c942-4f5e-a7e3-a98c7bed76ba
8672025-04-30T06:29:35.595ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63319,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49304 req_id = 86acfdec-c942-4f5e-a7e3-a98c7bed76ba
8682025-04-30T06:29:35.595ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63319, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_external-dns._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 13, 95, 101, 120, 116, 101, 114, 110, 97, 108, 45, 100, 110, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } SERVFAIL: server is not authoritative for name: "_external-dns._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:49304 req_id = 86acfdec-c942-4f5e-a7e3-a98c7bed76ba
8692025-04-30T06:29:35.595ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
8702025-04-30T06:29:35.595ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8712025-04-30T06:29:35.595ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
8722025-04-30T06:29:35.595ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8732025-04-30T06:29:35.597ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8742025-04-30T06:29:35.597ZINFOtest_image_create (dropshot_internal): accepted connection local_addr = 127.0.0.1:35774 remote_addr = 127.0.0.1:60329
8752025-04-30T06:29:35.597ZWARNtest_image_create (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_internal dns_group = internal error = no record found for Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8762025-04-30T06:29:35.597ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 209.040279ms iteration = 1 status = {"error":"failed to read list of DNS servers: no record found for Query { name: Name(\\"_nameservice._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8772025-04-30T06:29:35.597ZWARNtest_image_create (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_external dns_group = external error = no record found for Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8782025-04-30T06:29:35.598ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 207.131476ms iteration = 1 status = {"error":"failed to read list of DNS servers: no record found for Query { name: Name(\\"_external-dns._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8792025-04-30T06:29:35.605ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:60329 req_id = 6a4a328d-e8d0-4493-8d27-af114dcee86e uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
8802025-04-30T06:29:35.608ZINFOtest_image_create (nexus): registered sled agent sled_uuid = b6d65341-167c-41df-9b5c-41cded99c229
8812025-04-30T06:29:35.611ZINFOtest_image_create (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-04-30 06:19:35.391126393 UTC pruned = {}
8822025-04-30T06:29:35.611ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 220.034044ms iteration = 1 status = {"expiration":"2025-04-30T06:19:35.391126393Z","pruned":[]}
8832025-04-30T06:29:35.617ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8842025-04-30T06:29:35.631ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8852025-04-30T06:29:35.656ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: ca 25 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .%..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:60636 req_id = fca651a3-2c9e-46a6-a6ad-959b6be116a2
8862025-04-30T06:29:35.656ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 51749,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60636 req_id = fca651a3-2c9e-46a6-a6ad-959b6be116a2
8872025-04-30T06:29:35.657ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51749, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:60636 req_id = fca651a3-2c9e-46a6-a6ad-959b6be116a2
8882025-04-30T06:29:35.657ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: a4 c8 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:56412 req_id = 5d20fff1-7850-458d-83ec-fa68d2bd6389
8892025-04-30T06:29:35.657ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 42184,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56412 req_id = 5d20fff1-7850-458d-83ec-fa68d2bd6389
8902025-04-30T06:29:35.658ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42184, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:56412 req_id = 5d20fff1-7850-458d-83ec-fa68d2bd6389
8912025-04-30T06:29:35.659ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 264.858944ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8922025-04-30T06:29:35.670ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932025-04-30T06:29:35.689ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8942025-04-30T06:29:35.689ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
8952025-04-30T06:29:35.689ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8962025-04-30T06:29:35.690ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8972025-04-30T06:29:35.692ZERROtest_image_create (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_v4_garbage_collector error = no record found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8982025-04-30T06:29:35.692ZERROtest_image_create (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_v4_garbage_collector error = no record found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8992025-04-30T06:29:35.692ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 298.789158ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: no record found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9002025-04-30T06:29:35.692ZERROtest_image_create (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = no record found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9012025-04-30T06:29:35.692ZERROtest_image_create (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = no record found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9022025-04-30T06:29:35.693ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 298.452677ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: no record found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9032025-04-30T06:29:35.693ZDEBGtest_image_create (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9042025-04-30T06:29:35.701ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9052025-04-30T06:29:35.701ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database
9062025-04-30T06:29:35.701ZDEBGtest_image_create (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9072025-04-30T06:29:35.702ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9082025-04-30T06:29:35.715ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9092025-04-30T06:29:35.724ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9102025-04-30T06:29:35.724ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
9112025-04-30T06:29:35.724ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9122025-04-30T06:29:35.725ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9132025-04-30T06:29:35.727ZDEBGtest_image_create (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142025-04-30T06:29:35.756ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9152025-04-30T06:29:35.756ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database
9162025-04-30T06:29:35.756ZDEBGtest_image_create (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9172025-04-30T06:29:35.757ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9182025-04-30T06:29:35.773ZDEBGtest_image_create (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9192025-04-30T06:29:35.778ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
9202025-04-30T06:29:35.778ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database
9212025-04-30T06:29:35.778ZDEBGtest_image_create (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9222025-04-30T06:29:35.778ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
9232025-04-30T06:29:35.801ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9242025-04-30T06:29:35.840ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9252025-04-30T06:29:35.840ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database
9262025-04-30T06:29:35.840ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9272025-04-30T06:29:35.841ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9282025-04-30T06:29:35.856ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
9292025-04-30T06:29:35.880ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9302025-04-30T06:29:35.881ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9312025-04-30T06:29:35.883ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database
9322025-04-30T06:29:35.883ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9332025-04-30T06:29:35.886ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9342025-04-30T06:29:35.888ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database
9352025-04-30T06:29:35.889ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9362025-04-30T06:29:35.890ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9372025-04-30T06:29:35.894ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9382025-04-30T06:29:35.902ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9392025-04-30T06:29:35.902ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database
9402025-04-30T06:29:35.902ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9412025-04-30T06:29:35.903ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9422025-04-30T06:29:35.915ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 499.442196ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
9432025-04-30T06:29:35.978ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 565.957974ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
9442025-04-30T06:29:36.083ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9452025-04-30T06:29:36.087ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9462025-04-30T06:29:36.088ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet
9472025-04-30T06:29:36.088ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
9482025-04-30T06:29:36.088ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
9492025-04-30T06:29:36.088ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9502025-04-30T06:29:36.090ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9512025-04-30T06:29:36.091ZTRACtest_image_create (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = instance failed total_found = 0
9522025-04-30T06:29:36.091ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database
9532025-04-30T06:29:36.091ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9542025-04-30T06:29:36.091ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9552025-04-30T06:29:36.092ZINFOtest_image_create (SagaRecoverer): listed in-progress sagas count = 0
9562025-04-30T06:29:36.092ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 680.059976ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
9572025-04-30T06:29:36.095ZDEBGtest_image_create (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
9582025-04-30T06:29:36.098ZINFOtest_image_create (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
9592025-04-30T06:29:36.098ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 686.434606ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
9602025-04-30T06:29:36.113ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9612025-04-30T06:29:36.121ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
9622025-04-30T06:29:36.121ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet
9632025-04-30T06:29:36.122ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
9642025-04-30T06:29:36.122ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database
9652025-04-30T06:29:36.122ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
9662025-04-30T06:29:36.122ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
9672025-04-30T06:29:36.217ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9682025-04-30T06:29:36.228ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9692025-04-30T06:29:36.228ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database
9702025-04-30T06:29:36.228ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9712025-04-30T06:29:36.229ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9722025-04-30T06:29:36.229ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9732025-04-30T06:29:36.235ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9742025-04-30T06:29:36.236ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 818.031194ms iteration = 1 status = {"by_rx":{},"error":null}
9752025-04-30T06:29:36.256ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 842.156692ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
9762025-04-30T06:29:36.256ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database
9772025-04-30T06:29:36.256ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9782025-04-30T06:29:36.257ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9792025-04-30T06:29:36.271ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 854.290809ms iteration = 1 status = {"errors":[],"requests_created_ok":[]}
9802025-04-30T06:29:36.339ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
9812025-04-30T06:29:36.339ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9822025-04-30T06:29:36.340ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9832025-04-30T06:29:36.344ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig
9842025-04-30T06:29:36.344ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
9852025-04-30T06:29:36.344ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
9862025-04-30T06:29:36.344ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9872025-04-30T06:29:36.347ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9882025-04-30T06:29:36.349ZWARNtest_image_create (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0
9892025-04-30T06:29:36.349ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 962.59587ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
9902025-04-30T06:29:36.354ZWARNtest_image_create (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set
9912025-04-30T06:29:36.354ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 959.291246ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9922025-04-30T06:29:36.363ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 958.744977ms iteration = 1 status = {}
9932025-04-30T06:29:36.368ZWARNtest_image_create (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0
9942025-04-30T06:29:36.368ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 978.315069ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
9952025-04-30T06:29:36.370ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
9962025-04-30T06:29:36.370ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
9972025-04-30T06:29:36.375ZWARNtest_image_create (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker
9982025-04-30T06:29:36.375ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 971.285895ms iteration = 1 status = {"error":"inventory collection is None"}
9992025-04-30T06:29:36.377ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
10002025-04-30T06:29:36.377ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10012025-04-30T06:29:36.377ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10022025-04-30T06:29:36.378ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: e3 86 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:49462 req_id = 3c48292d-3e01-40e0-a696-3f96b88131c8
10032025-04-30T06:29:36.379ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 58246,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49462 req_id = 3c48292d-3e01-40e0-a696-3f96b88131c8
10042025-04-30T06:29:36.379ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58246, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:49462 req_id = 3c48292d-3e01-40e0-a696-3f96b88131c8
10052025-04-30T06:29:36.379ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: looking up MGS addresses: no record found for Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
10062025-04-30T06:29:36.380ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 984.253381ms iteration = 1 status = {"error":"failed to collect inventory: looking up MGS addresses: no record found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
10072025-04-30T06:29:36.481ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10082025-04-30T06:29:36.485ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10092025-04-30T06:29:36.486ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
10102025-04-30T06:29:36.486ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10112025-04-30T06:29:36.486ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10122025-04-30T06:29:36.498ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 1.090623466s iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10132025-04-30T06:29:36.506ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = region_replacement elapsed = 1.099039375s iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10142025-04-30T06:29:36.529ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet
10152025-04-30T06:29:36.529ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
10162025-04-30T06:29:36.529ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database
10172025-04-30T06:29:36.529ZDEBGtest_image_create (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10182025-04-30T06:29:36.533ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10192025-04-30T06:29:36.535ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
10202025-04-30T06:29:36.535ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
10212025-04-30T06:29:36.535ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
10222025-04-30T06:29:36.535ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
10232025-04-30T06:29:36.535ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10242025-04-30T06:29:36.536ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10252025-04-30T06:29:36.536ZINFOtest_image_create (dropshot_internal): request completed latency_us = 931645 local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:60329 req_id = 6a4a328d-e8d0-4493-8d27-af114dcee86e response_code = 204 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
10262025-04-30T06:29:36.536ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10272025-04-30T06:29:36.544ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
10282025-04-30T06:29:36.544ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database
10292025-04-30T06:29:36.544ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
10302025-04-30T06:29:36.545ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
10312025-04-30T06:29:36.547ZDEBGtest_image_create (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:35774/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229", status: 204, headers: {"x-request-id": "6a4a328d-e8d0-4493-8d27-af114dcee86e", "date": "Wed, 30 Apr 2025 06:29:35 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10322025-04-30T06:29:36.547ZDEBGtest_image_create (init_with_steps): Running step start_crucible_pantry
10332025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = GET path = /crucible/pantry/0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10342025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = GET path = /crucible/pantry/0/job/{id}/is-finished sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10352025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = GET path = /crucible/pantry/0/job/{id}/ok sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10362025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = DELETE path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10372025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = GET path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10382025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = POST path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10392025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = POST path = /crucible/pantry/0/volume/{id}/background sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10402025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = POST path = /crucible/pantry/0/volume/{id}/bulk-write sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10412025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = POST path = /crucible/pantry/0/volume/{id}/import-from-url sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10422025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = POST path = /crucible/pantry/0/volume/{id}/scrub sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10432025-04-30T06:29:36.549ZDEBGtest_image_create (dropshot): registered endpoint kind = pantry local_addr = [::1]:62787 method = POST path = /crucible/pantry/0/volume/{id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10442025-04-30T06:29:36.549ZINFOtest_image_create (dropshot): listening kind = pantry local_addr = [::1]:62787 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10452025-04-30T06:29:36.550ZDEBGtest_image_create (dropshot): successfully registered DTrace USDT probes kind = pantry local_addr = [::1]:62787 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10462025-04-30T06:29:36.550ZINFOtest_image_create (omicron_sled_agent::sim::Server): Started Simulated Crucible Pantry address = [::1]:62787 kind = pantry sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10472025-04-30T06:29:36.550ZDEBGtest_image_create (init_with_steps): Running step populate_internal_dns
10482025-04-30T06:29:36.550ZDEBGtest_image_create: Populating Internal DNS
10492025-04-30T06:29:36.656ZINFOtest_image_create: DNS population: DnsConfigParams { generation: Generation( 1, ), time_created: 2025-04-30T06:29:36.655980032Z, zones: [ DnsConfigZone { zone_name: "control-plane.oxide.internal", records: { "95345149-62a0-43ed-995a-6c04900e9866.host": [ Aaaa( ::1, ), ], "_clickhouse-native._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "95345149-62a0-43ed-995a-6c04900e9866.host.control-plane.oxide.internal", }, ), ], "c1e00a1c-93ca-4197-b980-fae75968e6a6.host": [ Aaaa( ::1, ), ], "_mgs._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 54825, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "_clickhouse-admin-single-server._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 8888, target: "95345149-62a0-43ed-995a-6c04900e9866.host.control-plane.oxide.internal", }, ), ], "_repo-depot._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 35864, target: "b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal", }, ), ], "_clickhouse._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 33529, target: "95345149-62a0-43ed-995a-6c04900e9866.host.control-plane.oxide.internal", }, ), ], "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host": [ Aaaa( ::1, ), ], "_cockroach._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 35301, target: "b77fdad2-2745-4f97-9227-973b8f5170af.host.control-plane.oxide.internal", }, ), ], "95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32.host": [ Aaaa( ::ffff:127.0.0.1, ), ], "_mgd._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 48880, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "_external-dns._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 59680, target: "f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal", }, ), ], "f637f6e2-41d7-4178-936b-513c30d8cbd3.host": [ Aaaa( ::1, ), ], "_nameservice._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 36192, target: "f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal", }, ), ], "_crucible-pantry._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 62787, target: "c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal", }, ), ], "f424d0e5-39db-489d-9cd8-97cfc1911ae4.host": [ Aaaa( ::1, ), ], "_dendrite._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 39702, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "_nexus._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 35774, target: "95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32.host.control-plane.oxide.internal", }, ), ], "b6d65341-167c-41df-9b5c-41cded99c229.sled": [ Aaaa( ::1, ), ], "_oximeter-reader._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "95345149-62a0-43ed-995a-6c04900e9866.host.control-plane.oxide.internal", }, ), ], "b77fdad2-2745-4f97-9227-973b8f5170af.host": [ Aaaa( ::1, ), ], }, }, ], }
10502025-04-30T06:29:36.656ZDEBGtest_image_create: client request body = Some(Body) method = PUT uri = http://[::1]:36192/config
10512025-04-30T06:29:36.661ZINFOtest_image_create (BackgroundTasks): all instance checks complete background_task = instance_watcher pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10522025-04-30T06:29:36.662ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.25401854s iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10532025-04-30T06:29:36.662ZTRACtest_image_create (BackgroundTasks): reprocessing 0 outdated webhook globs... background_task = webhook_dispatcher
10542025-04-30T06:29:36.662ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database
10552025-04-30T06:29:36.662ZDEBGtest_image_create (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
10562025-04-30T06:29:36.663ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
10572025-04-30T06:29:36.666ZINFOtest_image_create (http): accepted connection kind = dns local_addr = [::1]:36192 remote_addr = [::1]:47953
10582025-04-30T06:29:36.671ZTRACtest_image_create (http): incoming request kind = dns local_addr = [::1]:36192 method = PUT remote_addr = [::1]:47953 req_id = 3d33f9c8-1dd6-433f-ad9a-fd14f61cb38e uri = /config
10592025-04-30T06:29:36.672ZINFOtest_image_create (store): attempting generation update new_generation = 1 req_id = 3d33f9c8-1dd6-433f-ad9a-fd14f61cb38e
10602025-04-30T06:29:36.672ZINFOtest_image_create (store): pruning trees for generations newer than 0
10612025-04-30T06:29:36.672ZDEBGtest_image_create (store): creating tree tree_name = generation_1_zone_control-plane.oxide.internal
10622025-04-30T06:29:36.673ZDEBGtest_image_create (store): updating current config
10632025-04-30T06:29:36.674ZDEBGtest_image_create (store): flushing default tree
10642025-04-30T06:29:36.674ZINFOtest_image_create (store): pruning trees for generations older than 1 keep = 3
10652025-04-30T06:29:36.674ZINFOtest_image_create (store): updated generation new_generation = 1 req_id = 3d33f9c8-1dd6-433f-ad9a-fd14f61cb38e
10662025-04-30T06:29:36.674ZINFOtest_image_create (http): request completed kind = dns latency_us = 3750 local_addr = [::1]:36192 method = PUT remote_addr = [::1]:47953 req_id = 3d33f9c8-1dd6-433f-ad9a-fd14f61cb38e response_code = 204 uri = /config
10672025-04-30T06:29:36.676ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10682025-04-30T06:29:36.708ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
10692025-04-30T06:29:36.708ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
10702025-04-30T06:29:36.708ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10712025-04-30T06:29:36.708ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10722025-04-30T06:29:36.709ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
10732025-04-30T06:29:36.709ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
10742025-04-30T06:29:36.709ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
10752025-04-30T06:29:36.709ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10762025-04-30T06:29:36.709ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10772025-04-30T06:29:36.710ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 1.296507096s iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10782025-04-30T06:29:36.710ZTRACtest_image_create (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = start saga failed total_found = 0
10792025-04-30T06:29:36.710ZINFOtest_image_create (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
10802025-04-30T06:29:36.710ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 1.301061651s iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
10812025-04-30T06:29:36.711ZDEBGtest_image_create: client response result = Ok(Response { url: "http://[::1]:36192/config", status: 204, headers: {"x-request-id": "3d33f9c8-1dd6-433f-ad9a-fd14f61cb38e", "date": "Wed, 30 Apr 2025 06:29:36 GMT"} })
10822025-04-30T06:29:36.715ZDEBGtest_image_create (init_with_steps): Running step configure_sled_agents
10832025-04-30T06:29:36.783ZDEBGtest_image_create: client request body = Some(Body) method = PUT uri = http://[::1]:42828/omicron-config
10842025-04-30T06:29:36.830ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database
10852025-04-30T06:29:36.830ZDEBGtest_image_create (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10862025-04-30T06:29:36.836ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10872025-04-30T06:29:36.837ZDEBGtest_image_create (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10882025-04-30T06:29:36.847ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
10892025-04-30T06:29:36.847ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database
10902025-04-30T06:29:36.847ZDEBGtest_image_create (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10912025-04-30T06:29:36.848ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10922025-04-30T06:29:36.848ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:47276 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10932025-04-30T06:29:36.853ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = PUT remote_addr = [::1]:47276 req_id = c9d0e93b-681a-4934-84b8-186b028fa591 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
10942025-04-30T06:29:36.865ZINFOtest_image_create (dropshot): request completed latency_us = 11749 local_addr = [::1]:42828 method = PUT remote_addr = [::1]:47276 req_id = c9d0e93b-681a-4934-84b8-186b028fa591 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
10952025-04-30T06:29:36.951ZINFOtest_image_create (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
10962025-04-30T06:29:36.951ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:42828/vpc-routes
10972025-04-30T06:29:36.952ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10982025-04-30T06:29:36.957ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10992025-04-30T06:29:36.957ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
11002025-04-30T06:29:36.957ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11012025-04-30T06:29:36.957ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11022025-04-30T06:29:36.958ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet
11032025-04-30T06:29:36.958ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11042025-04-30T06:29:36.958ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
11052025-04-30T06:29:36.958ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11062025-04-30T06:29:36.958ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11072025-04-30T06:29:36.959ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:35432 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
11082025-04-30T06:29:36.960ZDEBGtest_image_create: client response result = Ok(Response { url: "http://[::1]:42828/omicron-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9d0e93b-681a-4934-84b8-186b028fa591", "content-length": "26", "date": "Wed, 30 Apr 2025 06:29:36 GMT"} })
11092025-04-30T06:29:36.960ZDEBGtest_image_create: client request body = Some(Body) method = PUT uri = http://[::1]:42828/network-bootstore-config
11102025-04-30T06:29:36.961ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:35432 req_id = 9e34e526-f396-4add-8587-dd126d638c00 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
11112025-04-30T06:29:36.966ZINFOtest_image_create (dropshot): request completed latency_us = 5014 local_addr = [::1]:42828 method = GET remote_addr = [::1]:35432 req_id = 9e34e526-f396-4add-8587-dd126d638c00 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
11122025-04-30T06:29:36.967ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = PUT remote_addr = [::1]:47276 req_id = d87b2ad4-2d87-4109-8319-1a566dffa6dc sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
11132025-04-30T06:29:36.968ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:42828/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e34e526-f396-4add-8587-dd126d638c00", "content-length": "2", "date": "Wed, 30 Apr 2025 06:29:36 GMT"} })
11142025-04-30T06:29:36.968ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
11152025-04-30T06:29:36.968ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11162025-04-30T06:29:36.968ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11172025-04-30T06:29:36.969ZINFOtest_image_create (dropshot): request completed latency_us = 1976 local_addr = [::1]:42828 method = PUT remote_addr = [::1]:47276 req_id = d87b2ad4-2d87-4109-8319-1a566dffa6dc response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
11182025-04-30T06:29:36.974ZDEBGtest_image_create: client response result = Ok(Response { url: "http://[::1]:42828/network-bootstore-config", status: 204, headers: {"x-request-id": "d87b2ad4-2d87-4109-8319-1a566dffa6dc", "date": "Wed, 30 Apr 2025 06:29:36 GMT"} })
11192025-04-30T06:29:36.976ZDEBGtest_image_create (init_with_steps): Running step start_nexus_external
11202025-04-30T06:29:36.976ZDEBGtest_image_create: Starting Nexus (external API)
11212025-04-30T06:29:39.917ZTRACtest_image_create (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
11222025-04-30T06:29:39.918ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11232025-04-30T06:29:39.918ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
11242025-04-30T06:29:39.918ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
11252025-04-30T06:29:39.920ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11262025-04-30T06:29:39.921ZTRACtest_image_create (BackgroundTasks): webhook dispatching completed successfully background_task = webhook_dispatcher events_dispatched = 0 events_without_receivers = 0
11272025-04-30T06:29:39.922ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 4.504305744s iteration = 1 status = {"dispatched":[],"errors":[],"glob_version":"140.0.0","globs_reprocessed":{},"no_receivers":[]}
11282025-04-30T06:29:39.922ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
11292025-04-30T06:29:39.922ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
11302025-04-30T06:29:39.922ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11312025-04-30T06:29:39.922ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11322025-04-30T06:29:39.923ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.507927872s iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11332025-04-30T06:29:39.923ZWARNtest_image_create (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone
11342025-04-30T06:29:39.923ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 4.530298905s iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
11352025-04-30T06:29:39.987ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet
11362025-04-30T06:29:39.987ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11372025-04-30T06:29:39.987ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database
11382025-04-30T06:29:39.987ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11392025-04-30T06:29:39.988ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11402025-04-30T06:29:39.989ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
11412025-04-30T06:29:39.989ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
11422025-04-30T06:29:39.989ZINFOtest_image_create (BackgroundTasks): No bundles to collect background_task = support_bundle_collector
11432025-04-30T06:29:39.989ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 4.592895344s iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
11442025-04-30T06:29:39.990ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452025-04-30T06:29:40.006ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11462025-04-30T06:29:40.007ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet
11472025-04-30T06:29:40.008ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11482025-04-30T06:29:40.008ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
11492025-04-30T06:29:40.008ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11502025-04-30T06:29:40.009ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11512025-04-30T06:29:40.015ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: c5 0e 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:58654 req_id = d3fa6a6d-ec70-45f8-aeb6-a96d1c03f30a
11522025-04-30T06:29:40.015ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 50446,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58654 req_id = d3fa6a6d-ec70-45f8-aeb6-a96d1c03f30a
11532025-04-30T06:29:40.015ZDEBGtest_image_create (store): query key key = _mgs._tcp
11542025-04-30T06:29:40.016ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
11552025-04-30T06:29:40.016ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:58654 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = d3fa6a6d-ec70-45f8-aeb6-a96d1c03f30a
11562025-04-30T06:29:40.017ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11572025-04-30T06:29:40.031ZDEBGtest_image_create (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
11582025-04-30T06:29:40.031ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
11592025-04-30T06:29:40.031ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
11602025-04-30T06:29:40.032ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11612025-04-30T06:29:40.033ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3444, tv_nsec: 832534243 } })
11622025-04-30T06:29:40.033ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
11632025-04-30T06:29:40.034ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11642025-04-30T06:29:40.034ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
11652025-04-30T06:29:40.034ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11662025-04-30T06:29:40.035ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11672025-04-30T06:29:40.046ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 17 4c 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .L..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:63991 req_id = fd164c23-868c-4937-86eb-d2897364fc54
11682025-04-30T06:29:40.046ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 5964,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63991 req_id = fd164c23-868c-4937-86eb-d2897364fc54
11692025-04-30T06:29:40.046ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
11702025-04-30T06:29:40.046ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:63991 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = fd164c23-868c-4937-86eb-d2897364fc54
11712025-04-30T06:29:40.046ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722025-04-30T06:29:40.051ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
11732025-04-30T06:29:40.051ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database
11742025-04-30T06:29:40.051ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11752025-04-30T06:29:40.052ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11762025-04-30T06:29:40.052ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11772025-04-30T06:29:40.056ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11782025-04-30T06:29:40.056ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
11792025-04-30T06:29:40.056ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11802025-04-30T06:29:40.057ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11812025-04-30T06:29:40.118ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
11822025-04-30T06:29:40.125ZINFOtest_image_create (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = sim-b6d65341
11832025-04-30T06:29:40.125ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:42828/eip-gateways
11842025-04-30T06:29:40.126ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852025-04-30T06:29:40.143ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11862025-04-30T06:29:40.143ZTRACtest_image_create (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
11872025-04-30T06:29:40.143ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
11882025-04-30T06:29:40.143ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
11892025-04-30T06:29:40.143ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
11902025-04-30T06:29:40.143ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11912025-04-30T06:29:40.144ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11922025-04-30T06:29:40.145ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet
11932025-04-30T06:29:40.145ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11942025-04-30T06:29:40.145ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database
11952025-04-30T06:29:40.145ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11962025-04-30T06:29:40.146ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11972025-04-30T06:29:40.166ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
11982025-04-30T06:29:40.167ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
11992025-04-30T06:29:40.167ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12002025-04-30T06:29:40.169ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12012025-04-30T06:29:40.281ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:42828/v2p
12022025-04-30T06:29:40.289ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12032025-04-30T06:29:40.289ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12042025-04-30T06:29:40.289ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12052025-04-30T06:29:40.290ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12062025-04-30T06:29:40.298ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12072025-04-30T06:29:40.304ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
12082025-04-30T06:29:40.304ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database
12092025-04-30T06:29:40.304ZDEBGtest_image_create (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
12102025-04-30T06:29:40.310ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
12112025-04-30T06:29:40.311ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
12122025-04-30T06:29:40.311ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
12132025-04-30T06:29:40.314ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12142025-04-30T06:29:40.317ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:44468 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12152025-04-30T06:29:40.319ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = PUT remote_addr = [::1]:35432 req_id = 00b77a1d-a0cf-4697-bab8-89a8098c8c11 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
12162025-04-30T06:29:40.323ZINFOtest_image_create (dropshot): request completed latency_us = 4018 local_addr = [::1]:42828 method = PUT remote_addr = [::1]:35432 req_id = 00b77a1d-a0cf-4697-bab8-89a8098c8c11 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
12172025-04-30T06:29:40.323ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12182025-04-30T06:29:40.334ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12192025-04-30T06:29:40.334ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12202025-04-30T06:29:40.334ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12212025-04-30T06:29:40.335ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12222025-04-30T06:29:40.342ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:44468 req_id = 00af01f4-e2e2-4737-b473-ec826247faf5 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
12232025-04-30T06:29:40.342ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: ef e0 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:62447 req_id = 56b93247-6477-4d01-a480-ba2149b2f893
12242025-04-30T06:29:40.342ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61408,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62447 req_id = 56b93247-6477-4d01-a480-ba2149b2f893
12252025-04-30T06:29:40.343ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
12262025-04-30T06:29:40.343ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61408, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:62447 req_id = 56b93247-6477-4d01-a480-ba2149b2f893
12272025-04-30T06:29:40.343ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:42828/eip-gateways", status: 204, headers: {"x-request-id": "00b77a1d-a0cf-4697-bab8-89a8098c8c11", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
12282025-04-30T06:29:40.345ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 4.934533215s iteration = 1 status = {}
12292025-04-30T06:29:40.346ZINFOtest_image_create (dropshot): request completed latency_us = 3500 local_addr = [::1]:42828 method = GET remote_addr = [::1]:44468 req_id = 00af01f4-e2e2-4737-b473-ec826247faf5 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
12302025-04-30T06:29:40.346ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[::1]:42828/artifacts-config
12312025-04-30T06:29:40.347ZINFOtest_image_create (InternalApi): set cockroachdb setting setting = cluster.preserve_downgrade_option value = 22.1
12322025-04-30T06:29:40.348ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
12332025-04-30T06:29:40.348ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
12342025-04-30T06:29:40.350ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12352025-04-30T06:29:40.351ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:43481 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12362025-04-30T06:29:40.351ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
12372025-04-30T06:29:40.351ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
12382025-04-30T06:29:40.352ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
12392025-04-30T06:29:40.354ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:42828/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "00af01f4-e2e2-4737-b473-ec826247faf5", "content-length": "2", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
12402025-04-30T06:29:40.354ZINFOtest_image_create (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = sim-b6d65341
12412025-04-30T06:29:40.354ZINFOtest_image_create (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = sim-b6d65341
12422025-04-30T06:29:40.354ZINFOtest_image_create (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [] sled = sim-b6d65341
12432025-04-30T06:29:40.356ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 4.95090751s iteration = 1 status = {}
12442025-04-30T06:29:40.357ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12452025-04-30T06:29:40.358ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12462025-04-30T06:29:40.358ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12472025-04-30T06:29:40.361ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = PUT remote_addr = [::1]:43481 req_id = 264a5bce-20d6-4659-873a-50be7caad9bb sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config
12482025-04-30T06:29:40.362ZINFOtest_image_create (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpMxaQy9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12492025-04-30T06:29:40.362ZDEBGtest_image_create (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpMxaQy9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12502025-04-30T06:29:40.362ZINFOtest_image_create (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpHaOyf9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12512025-04-30T06:29:40.362ZDEBGtest_image_create (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpHaOyf9/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12522025-04-30T06:29:40.362ZINFOtest_image_create (ArtifactStore): Writing ledger to /var/tmp/omicron_tmp/.tmpMxaQy9/.artifact-config.json.tmp server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12532025-04-30T06:29:40.364ZINFOtest_image_create (ArtifactStore): Writing ledger to /var/tmp/omicron_tmp/.tmpHaOyf9/.artifact-config.json.tmp server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12542025-04-30T06:29:40.364ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
12552025-04-30T06:29:40.364ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12562025-04-30T06:29:40.365ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
12572025-04-30T06:29:40.365ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
12582025-04-30T06:29:40.365ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12592025-04-30T06:29:40.394ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12602025-04-30T06:29:40.394ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12612025-04-30T06:29:40.395ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12622025-04-30T06:29:40.395ZINFOtest_image_create (ArtifactStore): Starting delete reconciler generation = 1 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
12632025-04-30T06:29:40.396ZINFOtest_image_create (dropshot): request completed latency_us = 34731 local_addr = [::1]:42828 method = PUT remote_addr = [::1]:43481 req_id = 264a5bce-20d6-4659-873a-50be7caad9bb response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config
12642025-04-30T06:29:40.398ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[::1]:42828/artifacts-config", status: 204, headers: {"x-request-id": "264a5bce-20d6-4659-873a-50be7caad9bb", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
12652025-04-30T06:29:40.398ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication body = None method = GET uri = http://[::1]:42828/artifacts
12662025-04-30T06:29:40.399ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672025-04-30T06:29:40.411ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
12682025-04-30T06:29:40.412ZDEBGtest_image_create (InternalApi): updating rack subnet for rack c19a698f-c6f9-4a17-ae30-20d711b8f7dc to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), )
12692025-04-30T06:29:40.412ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
12702025-04-30T06:29:40.413ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
12712025-04-30T06:29:40.414ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12722025-04-30T06:29:40.419ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:43481 req_id = c271d89b-7db7-470c-b519-48cdc170ece6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts
12732025-04-30T06:29:40.424ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12742025-04-30T06:29:40.424ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12752025-04-30T06:29:40.425ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12762025-04-30T06:29:40.425ZINFOtest_image_create (dropshot): request completed latency_us = 5788 local_addr = [::1]:42828 method = GET remote_addr = [::1]:43481 req_id = c271d89b-7db7-470c-b519-48cdc170ece6 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts
12772025-04-30T06:29:40.426ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[::1]:42828/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "c271d89b-7db7-470c-b519-48cdc170ece6", "content-length": "26", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
12782025-04-30T06:29:40.429ZINFOtest_image_create (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication sled = http://[::1]:42828
12792025-04-30T06:29:40.432ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 5.015576499s iteration = 1 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"b6d65341-167c-41df-9b5c-41cded99c229","time":"2025-04-30T06:29:40.398530589Z"},{"operation":"list","target_sled":"b6d65341-167c-41df-9b5c-41cded99c229","time":"2025-04-30T06:29:40.429350716Z"}]}
12802025-04-30T06:29:40.432ZINFOtest_image_create (InternalApi): Using static configuration for external switchports
12812025-04-30T06:29:40.432ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
12822025-04-30T06:29:40.432ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
12832025-04-30T06:29:40.433ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12842025-04-30T06:29:40.440ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
12852025-04-30T06:29:40.440ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
12862025-04-30T06:29:40.440ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12872025-04-30T06:29:40.440ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12882025-04-30T06:29:40.440ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12892025-04-30T06:29:40.441ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "b63d479d-4238-4350-9c3e-7399731aea52", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
12902025-04-30T06:29:40.442ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
12912025-04-30T06:29:40.457ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
12922025-04-30T06:29:40.457ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12932025-04-30T06:29:40.457ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12942025-04-30T06:29:40.458ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12952025-04-30T06:29:40.461ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12962025-04-30T06:29:40.461ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
12972025-04-30T06:29:40.461ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12982025-04-30T06:29:40.461ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12992025-04-30T06:29:40.471ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4c7d07b-1112-41d6-b0e5-00c1dee2c8ab", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
13002025-04-30T06:29:40.471ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
13012025-04-30T06:29:40.471ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13022025-04-30T06:29:40.479ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13032025-04-30T06:29:40.480ZTRACtest_image_create (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
13042025-04-30T06:29:40.480ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13052025-04-30T06:29:40.480ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13062025-04-30T06:29:40.480ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13072025-04-30T06:29:40.485ZINFOtest_image_create (InternalApi): Recording Rack Network Configuration
13082025-04-30T06:29:40.485ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
13092025-04-30T06:29:40.485ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
13102025-04-30T06:29:40.486ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13112025-04-30T06:29:40.490ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13122025-04-30T06:29:40.490ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13132025-04-30T06:29:40.490ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13142025-04-30T06:29:40.499ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13152025-04-30T06:29:40.499ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13162025-04-30T06:29:40.500ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13172025-04-30T06:29:40.509ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13182025-04-30T06:29:40.509ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13192025-04-30T06:29:40.510ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13202025-04-30T06:29:40.528ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
13212025-04-30T06:29:40.528ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
13222025-04-30T06:29:40.528ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13232025-04-30T06:29:40.528ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13242025-04-30T06:29:40.530ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13252025-04-30T06:29:40.554ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
13262025-04-30T06:29:40.554ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13272025-04-30T06:29:40.554ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13282025-04-30T06:29:40.556ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13292025-04-30T06:29:40.563ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13302025-04-30T06:29:40.564ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13312025-04-30T06:29:40.564ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13322025-04-30T06:29:40.564ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13332025-04-30T06:29:40.568ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13342025-04-30T06:29:40.578ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13352025-04-30T06:29:40.578ZTRACtest_image_create (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
13362025-04-30T06:29:40.578ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
13372025-04-30T06:29:40.578ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
13382025-04-30T06:29:40.578ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13392025-04-30T06:29:40.578ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13402025-04-30T06:29:40.585ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13412025-04-30T06:29:40.640ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
13422025-04-30T06:29:40.640ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13432025-04-30T06:29:40.640ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13442025-04-30T06:29:40.641ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13452025-04-30T06:29:40.650ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13462025-04-30T06:29:40.650ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13472025-04-30T06:29:40.650ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13482025-04-30T06:29:40.652ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13492025-04-30T06:29:40.655ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "31987a64-6e4c-42f0-832a-cb2c01f9ac0c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
13502025-04-30T06:29:40.656ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
13512025-04-30T06:29:40.659ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13522025-04-30T06:29:40.692ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13532025-04-30T06:29:40.692ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13542025-04-30T06:29:40.692ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13552025-04-30T06:29:40.693ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13562025-04-30T06:29:40.694ZTRACtest_image_create (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
13572025-04-30T06:29:40.694ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13582025-04-30T06:29:40.694ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
13592025-04-30T06:29:40.694ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
13602025-04-30T06:29:40.695ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13612025-04-30T06:29:40.706ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13622025-04-30T06:29:40.716ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13632025-04-30T06:29:40.716ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13642025-04-30T06:29:40.719ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13652025-04-30T06:29:40.724ZDEBGtest_image_create (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
13662025-04-30T06:29:40.724ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
13672025-04-30T06:29:40.724ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
13682025-04-30T06:29:40.725ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13692025-04-30T06:29:40.733ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13702025-04-30T06:29:40.733ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13712025-04-30T06:29:40.737ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13722025-04-30T06:29:40.749ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13732025-04-30T06:29:40.749ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13742025-04-30T06:29:40.750ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13752025-04-30T06:29:40.751ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = IpPool { parent: Fleet, key: b35b7a2a-0e0d-448c-bd39-0cfc18e20581, lookup_type: ByName("oxide-service-pool") }
13762025-04-30T06:29:40.751ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13772025-04-30T06:29:40.751ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
13782025-04-30T06:29:40.751ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
13792025-04-30T06:29:40.752ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13802025-04-30T06:29:40.766ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13812025-04-30T06:29:40.766ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13822025-04-30T06:29:40.779ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13832025-04-30T06:29:40.784ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
13842025-04-30T06:29:40.785ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
13852025-04-30T06:29:40.785ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13862025-04-30T06:29:40.785ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13872025-04-30T06:29:40.791ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13882025-04-30T06:29:40.791ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13892025-04-30T06:29:40.819ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = IpPool { parent: Fleet, key: b35b7a2a-0e0d-448c-bd39-0cfc18e20581, lookup_type: ByName("oxide-service-pool") } result = Ok(())
13902025-04-30T06:29:40.819ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
13912025-04-30T06:29:40.819ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
13922025-04-30T06:29:40.819ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13932025-04-30T06:29:40.825ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
13942025-04-30T06:29:40.826ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
13952025-04-30T06:29:40.826ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13962025-04-30T06:29:40.826ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13972025-04-30T06:29:40.829ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "71a304b1-3a94-44ef-9601-053aca850f3b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
13982025-04-30T06:29:40.829ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
13992025-04-30T06:29:40.829ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14002025-04-30T06:29:40.829ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
14012025-04-30T06:29:40.829ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14022025-04-30T06:29:40.830ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14032025-04-30T06:29:40.836ZTRACtest_image_create (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = IpPool { parent: Fleet, key: b35b7a2a-0e0d-448c-bd39-0cfc18e20581, lookup_type: ByName("oxide-service-pool") }
14042025-04-30T06:29:40.836ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14052025-04-30T06:29:40.836ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
14062025-04-30T06:29:40.836ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
14072025-04-30T06:29:40.837ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14082025-04-30T06:29:40.838ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092025-04-30T06:29:40.847ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14102025-04-30T06:29:40.847ZTRACtest_image_create (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
14112025-04-30T06:29:40.847ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
14122025-04-30T06:29:40.847ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
14132025-04-30T06:29:40.847ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
14142025-04-30T06:29:40.847ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14152025-04-30T06:29:40.848ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14162025-04-30T06:29:40.853ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172025-04-30T06:29:40.857ZDEBGtest_image_create (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = IpPool { parent: Fleet, key: b35b7a2a-0e0d-448c-bd39-0cfc18e20581, lookup_type: ByName("oxide-service-pool") } result = Ok(())
14182025-04-30T06:29:40.858ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
14192025-04-30T06:29:40.858ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
14202025-04-30T06:29:40.858ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14212025-04-30T06:29:40.859ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14222025-04-30T06:29:40.871ZTRACtest_image_create (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = IpPool { parent: Fleet, key: b35b7a2a-0e0d-448c-bd39-0cfc18e20581, lookup_type: ByName("oxide-service-pool") }
14232025-04-30T06:29:40.872ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14242025-04-30T06:29:40.872ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
14252025-04-30T06:29:40.872ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
14262025-04-30T06:29:40.877ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14272025-04-30T06:29:40.879ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14282025-04-30T06:29:40.879ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
14292025-04-30T06:29:40.879ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14302025-04-30T06:29:40.880ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14312025-04-30T06:29:40.885ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322025-04-30T06:29:40.892ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14332025-04-30T06:29:40.892ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
14342025-04-30T06:29:40.892ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14352025-04-30T06:29:40.892ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14362025-04-30T06:29:40.894ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372025-04-30T06:29:40.899ZDEBGtest_image_create (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = IpPool { parent: Fleet, key: b35b7a2a-0e0d-448c-bd39-0cfc18e20581, lookup_type: ByName("oxide-service-pool") } result = Ok(())
14382025-04-30T06:29:40.910ZTRACtest_image_create (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = BlueprintConfig
14392025-04-30T06:29:40.911ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14402025-04-30T06:29:40.911ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
14412025-04-30T06:29:40.911ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
14422025-04-30T06:29:40.911ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14432025-04-30T06:29:40.913ZDEBGtest_image_create (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
14442025-04-30T06:29:40.913ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet
14452025-04-30T06:29:40.913ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14462025-04-30T06:29:40.913ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
14472025-04-30T06:29:40.913ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14482025-04-30T06:29:40.914ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14492025-04-30T06:29:40.919ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14502025-04-30T06:29:40.922ZDEBGtest_image_create (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = BlueprintConfig result = Ok(())
14512025-04-30T06:29:40.927ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14522025-04-30T06:29:40.932ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
14532025-04-30T06:29:40.932ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database
14542025-04-30T06:29:40.932ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14552025-04-30T06:29:40.932ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14562025-04-30T06:29:40.942ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f481d1fe-feaf-40bc-a1b2-389e886139ef", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14572025-04-30T06:29:40.943ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
14582025-04-30T06:29:40.951ZTRACtest_image_create (service-firewall-rule-progator): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2025-04-30T06:06:08.248500Z, time_modified: 2025-04-30T06:06:08.248500Z, allowed_ips: None } background_task = service_firewall_rule_propagation
14592025-04-30T06:29:40.951ZDEBGtest_image_create (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
14602025-04-30T06:29:40.951ZDEBGtest_image_create (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
14612025-04-30T06:29:40.951ZDEBGtest_image_create (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
14622025-04-30T06:29:40.978ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "46e5e238-10e4-4a38-8456-6cc5dc7af099", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14632025-04-30T06:29:40.978ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
14642025-04-30T06:29:40.981ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e3242ea-dc1b-45e0-a647-174fbac33543", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14652025-04-30T06:29:40.981ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
14662025-04-30T06:29:40.984ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "844e73d5-6707-439b-a988-037a1f38b1b7", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14672025-04-30T06:29:40.984ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
14682025-04-30T06:29:40.986ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cb0493d-4b2a-4465-98fd-1c5dff369d53", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14692025-04-30T06:29:40.986ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
14702025-04-30T06:29:40.987ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6883d550-19a5-46a2-ab96-16f8001382b1", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14712025-04-30T06:29:40.988ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
14722025-04-30T06:29:40.990ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "27484f0f-52dc-4650-bcb8-bdcd65078bd4", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14732025-04-30T06:29:40.990ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
14742025-04-30T06:29:40.990ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "94891285-2881-406e-a7db-e072d4d89db0", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14752025-04-30T06:29:40.991ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
14762025-04-30T06:29:40.992ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "71ec3bf8-9466-4313-b1bf-e795ef5a0af2", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14772025-04-30T06:29:40.993ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
14782025-04-30T06:29:40.996ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec20d244-71c9-4579-8a3c-d1dec0708179", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14792025-04-30T06:29:40.996ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
14802025-04-30T06:29:41.001ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "139b350e-37f8-427a-8f82-ccc5115a1c15", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14812025-04-30T06:29:41.002ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
14822025-04-30T06:29:41.010ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3050f6f-ede6-464d-8315-8cce687b8bf2", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:40 GMT"} })
14832025-04-30T06:29:41.010ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
14842025-04-30T06:29:41.014ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "39ddbb40-662d-4801-a0d5-5f8a59a71923", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
14852025-04-30T06:29:41.014ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
14862025-04-30T06:29:41.017ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6110aa5a-3a2f-4bcf-9213-cb7cdd8e7c65", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
14872025-04-30T06:29:41.017ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
14882025-04-30T06:29:41.020ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef805d87-d667-4e44-b46b-b1301b6ef2ef", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
14892025-04-30T06:29:41.020ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
14902025-04-30T06:29:41.022ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "78d9354f-a35f-44f3-ac9c-d9fc6c1a40a0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
14912025-04-30T06:29:41.022ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
14922025-04-30T06:29:41.040ZDEBGtest_image_create (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
14932025-04-30T06:29:41.040ZDEBGtest_image_create (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
14942025-04-30T06:29:41.040ZINFOtest_image_create (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation
14952025-04-30T06:29:41.040ZDEBGtest_image_create (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 5.630388901s
14962025-04-30T06:29:41.040ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 5.630439753s iteration = 1 status = {}
14972025-04-30T06:29:41.041ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "34a643b7-1f50-4a09-9124-c282991c1341", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
14982025-04-30T06:29:41.041ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
14992025-04-30T06:29:41.043ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf64572f-7dc4-413b-87b5-d38fad281e62", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15002025-04-30T06:29:41.043ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
15012025-04-30T06:29:41.044ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "78768dbc-6ba6-498b-9f58-273f84319f06", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15022025-04-30T06:29:41.045ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
15032025-04-30T06:29:41.076ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5a80d14-fcff-4202-acc2-c92a58add41d", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15042025-04-30T06:29:41.076ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
15052025-04-30T06:29:41.078ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd1e5343-63e7-48e6-b4a4-e245a6cff87b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15062025-04-30T06:29:41.079ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
15072025-04-30T06:29:41.081ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c60eff1-b34f-4a17-be60-efbc4eeb1314", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15082025-04-30T06:29:41.081ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
15092025-04-30T06:29:41.091ZINFOtest_image_create (InternalApi): inserted blueprint blueprint_id = a3a0f1e6-3f3f-4ed8-9552-035ef8d70050
15102025-04-30T06:29:41.091ZTRACtest_image_create (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = BlueprintConfig
15112025-04-30T06:29:41.091ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15122025-04-30T06:29:41.091ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
15132025-04-30T06:29:41.091ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
15142025-04-30T06:29:41.092ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15152025-04-30T06:29:41.092ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ebaa1a1-a30a-4335-8048-cfb0c5abe9b0", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15162025-04-30T06:29:41.093ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
15172025-04-30T06:29:41.095ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15182025-04-30T06:29:41.102ZDEBGtest_image_create (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = BlueprintConfig result = Ok(())
15192025-04-30T06:29:41.103ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a40b6153-337c-4399-bd14-c588088a7e74", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15202025-04-30T06:29:41.103ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
15212025-04-30T06:29:41.106ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0441f38-855d-49b3-8a8b-ba18c0634fc1", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15222025-04-30T06:29:41.106ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
15232025-04-30T06:29:41.107ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d342fbf-1f6d-4975-95da-e972b4d0fdcf", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15242025-04-30T06:29:41.108ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
15252025-04-30T06:29:41.108ZINFOtest_image_create (InternalApi): No networking records needed for clickhouse service
15262025-04-30T06:29:41.109ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "74057f94-8155-4aab-b308-8c634b569c66", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15272025-04-30T06:29:41.109ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
15282025-04-30T06:29:41.110ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e174e12-0e3b-4387-a3a9-05cb657d2886", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15292025-04-30T06:29:41.110ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
15302025-04-30T06:29:41.111ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4f562c0-bdf2-439b-9b7e-dad6c58234cf", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15312025-04-30T06:29:41.112ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
15322025-04-30T06:29:41.195ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "98b5d1df-3919-468e-9af4-8eaa2ec73e2e", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15332025-04-30T06:29:41.195ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
15342025-04-30T06:29:41.197ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90583d89-f391-471d-a378-8f364bf7b0be", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15352025-04-30T06:29:41.197ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
15362025-04-30T06:29:41.199ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e2f1354-c8b8-4498-925e-cb547e4ca524", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15372025-04-30T06:29:41.199ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
15382025-04-30T06:29:41.202ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e674c18e-744a-487b-ac2a-e2c697f27554", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15392025-04-30T06:29:41.202ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
15402025-04-30T06:29:41.203ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f5b3b5a-e5bb-4186-9894-1f437afa5192", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15412025-04-30T06:29:41.203ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
15422025-04-30T06:29:41.204ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccd5ef7a-25c8-4ac5-b4b7-aa71b3bf11a6", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15432025-04-30T06:29:41.204ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
15442025-04-30T06:29:41.231ZINFOtest_image_create (InternalApi): Inserted networking records for nexus service
15452025-04-30T06:29:41.231ZINFOtest_image_create (InternalApi): No networking records needed for cockroach_db service
15462025-04-30T06:29:41.231ZINFOtest_image_create (InternalApi): No networking records needed for crucible_pantry service
15472025-04-30T06:29:41.231ZINFOtest_image_create (InternalApi): No networking records needed for internal_dns service
15482025-04-30T06:29:41.232ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "62db7fbf-2ff5-43da-8a15-afdcb389050f", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15492025-04-30T06:29:41.233ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
15502025-04-30T06:29:41.247ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "21e34312-f2a5-4db8-9b8a-2abb081c792a", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15512025-04-30T06:29:41.247ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
15522025-04-30T06:29:41.248ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7950e84-4e0d-4208-9502-44308ba341e0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15532025-04-30T06:29:41.248ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
15542025-04-30T06:29:41.249ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6da8025-e4da-4589-a1f6-9fa3db0336ea", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15552025-04-30T06:29:41.249ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
15562025-04-30T06:29:41.250ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b43877f7-c1a7-4132-a141-734474a37da5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15572025-04-30T06:29:41.250ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
15582025-04-30T06:29:41.255ZINFOtest_image_create (InternalApi): Inserted networking records for external_dns service
15592025-04-30T06:29:41.262ZINFOtest_image_create (InternalApi): Inserted service networking records
15602025-04-30T06:29:41.262ZINFOtest_image_create (InternalApi): Inserted physical disks
15612025-04-30T06:29:41.262ZINFOtest_image_create (InternalApi): Inserted zpools
15622025-04-30T06:29:41.262ZINFOtest_image_create (InternalApi): Inserted datasets
15632025-04-30T06:29:41.263ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "14f3e2d5-f1f1-445f-a6d1-ef5ea032989a", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15642025-04-30T06:29:41.263ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
15652025-04-30T06:29:41.263ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15662025-04-30T06:29:41.263ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
15672025-04-30T06:29:41.263ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15682025-04-30T06:29:41.264ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15692025-04-30T06:29:41.268ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702025-04-30T06:29:41.273ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15712025-04-30T06:29:41.273ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
15722025-04-30T06:29:41.273ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15732025-04-30T06:29:41.273ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
15742025-04-30T06:29:41.274ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15752025-04-30T06:29:41.274ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15762025-04-30T06:29:41.278ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15772025-04-30T06:29:41.282ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15782025-04-30T06:29:41.282ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
15792025-04-30T06:29:41.282ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15802025-04-30T06:29:41.283ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15812025-04-30T06:29:41.333ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
15822025-04-30T06:29:41.335ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
15832025-04-30T06:29:41.336ZINFOtest_image_create (InternalApi): Populated DNS tables for internal DNS
15842025-04-30T06:29:41.344ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:33722 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15852025-04-30T06:29:41.345ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:33722 req_id = 63601696-d379-4967-ac7f-1b5a6332c0b1 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
15862025-04-30T06:29:41.345ZINFOtest_image_create (dropshot): request completed latency_us = 916 local_addr = [::1]:42828 method = GET remote_addr = [::1]:33722 req_id = 63601696-d379-4967-ac7f-1b5a6332c0b1 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
15872025-04-30T06:29:41.346ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "63601696-d379-4967-ac7f-1b5a6332c0b1", "content-length": "2769", "date": "Wed, 30 Apr 2025 06:29:41 GMT"} })
15882025-04-30T06:29:41.348ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
15892025-04-30T06:29:41.349ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
15902025-04-30T06:29:41.349ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
15912025-04-30T06:29:41.350ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
15922025-04-30T06:29:41.351ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15932025-04-30T06:29:41.351ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
15942025-04-30T06:29:41.351ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15952025-04-30T06:29:41.351ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15962025-04-30T06:29:41.358ZINFOtest_image_create (InternalApi): Populated DNS tables for external DNS
15972025-04-30T06:29:41.358ZTRACtest_image_create (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
15982025-04-30T06:29:41.358ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15992025-04-30T06:29:41.359ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16002025-04-30T06:29:41.359ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16012025-04-30T06:29:41.359ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16022025-04-30T06:29:41.361ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032025-04-30T06:29:41.365ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
16042025-04-30T06:29:41.366ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
16052025-04-30T06:29:41.366ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16062025-04-30T06:29:41.367ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16072025-04-30T06:29:41.367ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16082025-04-30T06:29:41.371ZDEBGtest_image_create (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
16092025-04-30T06:29:41.371ZTRACtest_image_create (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
16102025-04-30T06:29:41.371ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16112025-04-30T06:29:41.371ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16122025-04-30T06:29:41.371ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16132025-04-30T06:29:41.372ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16142025-04-30T06:29:41.378ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16152025-04-30T06:29:41.381ZDEBGtest_image_create (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
16162025-04-30T06:29:41.427ZTRACtest_image_create (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = DnsConfig
16172025-04-30T06:29:41.433ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16182025-04-30T06:29:41.433ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16192025-04-30T06:29:41.433ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16202025-04-30T06:29:41.434ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16212025-04-30T06:29:41.474ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16222025-04-30T06:29:41.485ZDEBGtest_image_create (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = DnsConfig result = Ok(())
16232025-04-30T06:29:41.485ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = DnsConfig
16242025-04-30T06:29:41.485ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16252025-04-30T06:29:41.485ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16262025-04-30T06:29:41.485ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16272025-04-30T06:29:41.486ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16282025-04-30T06:29:41.497ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16292025-04-30T06:29:41.503ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = DnsConfig result = Ok(())
16302025-04-30T06:29:41.509ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = DnsConfig
16312025-04-30T06:29:41.510ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16322025-04-30T06:29:41.510ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16332025-04-30T06:29:41.511ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16342025-04-30T06:29:41.511ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16352025-04-30T06:29:41.528ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16362025-04-30T06:29:41.540ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = DnsConfig result = Ok(())
16372025-04-30T06:29:41.560ZINFOtest_image_create (InternalApi): Created recovery silo
16382025-04-30T06:29:41.561ZINFOtest_image_create (InternalApi): Created recovery user
16392025-04-30T06:29:41.565ZINFOtest_image_create (InternalApi): Created recovery user's password
16402025-04-30T06:29:41.565ZTRACtest_image_create (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Silo { parent: Fleet, key: 48067caf-f65c-4aea-85c4-070ab101db1b, lookup_type: ById(48067caf-f65c-4aea-85c4-070ab101db1b) }
16412025-04-30T06:29:41.565ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 48067caf-f65c-4aea-85c4-070ab101db1b resource_type = Silo
16422025-04-30T06:29:41.565ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16432025-04-30T06:29:41.565ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16442025-04-30T06:29:41.566ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16452025-04-30T06:29:41.568ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16462025-04-30T06:29:41.568ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16472025-04-30T06:29:41.568ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16482025-04-30T06:29:41.571ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16492025-04-30T06:29:41.580ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16502025-04-30T06:29:41.583ZDEBGtest_image_create (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Silo { parent: Fleet, key: 48067caf-f65c-4aea-85c4-070ab101db1b, lookup_type: ById(48067caf-f65c-4aea-85c4-070ab101db1b) } result = Ok(())
16512025-04-30T06:29:41.583ZDEBGtest_image_create (InternalApi): Generated role assignment queries
16522025-04-30T06:29:41.587ZINFOtest_image_create (InternalApi): Granted Silo privileges
16532025-04-30T06:29:41.587ZTRACtest_image_create (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
16542025-04-30T06:29:41.587ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16552025-04-30T06:29:41.587ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16562025-04-30T06:29:41.587ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16572025-04-30T06:29:41.587ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16582025-04-30T06:29:41.593ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592025-04-30T06:29:41.596ZDEBGtest_image_create (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
16602025-04-30T06:29:41.607ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16612025-04-30T06:29:41.607ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16622025-04-30T06:29:41.609ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16632025-04-30T06:29:41.612ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16642025-04-30T06:29:41.612ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16652025-04-30T06:29:41.612ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16662025-04-30T06:29:41.614ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16672025-04-30T06:29:41.614ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16682025-04-30T06:29:41.615ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16692025-04-30T06:29:41.618ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
16702025-04-30T06:29:41.618ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16712025-04-30T06:29:41.619ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16722025-04-30T06:29:41.619ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16732025-04-30T06:29:41.621ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16742025-04-30T06:29:41.624ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16752025-04-30T06:29:41.624ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16762025-04-30T06:29:41.624ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16772025-04-30T06:29:41.625ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16782025-04-30T06:29:41.630ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16792025-04-30T06:29:41.630ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16802025-04-30T06:29:41.630ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16812025-04-30T06:29:41.630ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16822025-04-30T06:29:41.634ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16832025-04-30T06:29:41.640ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
16842025-04-30T06:29:41.640ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
16852025-04-30T06:29:41.640ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
16862025-04-30T06:29:41.640ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16872025-04-30T06:29:41.640ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16882025-04-30T06:29:41.640ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16892025-04-30T06:29:41.641ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16902025-04-30T06:29:41.643ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16912025-04-30T06:29:41.643ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16922025-04-30T06:29:41.643ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16932025-04-30T06:29:41.643ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16942025-04-30T06:29:41.653ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16952025-04-30T06:29:41.653ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
16962025-04-30T06:29:41.653ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
16972025-04-30T06:29:41.654ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16982025-04-30T06:29:41.656ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16992025-04-30T06:29:41.685ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17002025-04-30T06:29:41.686ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17012025-04-30T06:29:41.687ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17022025-04-30T06:29:41.688ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17032025-04-30T06:29:41.695ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17042025-04-30T06:29:41.695ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17052025-04-30T06:29:41.696ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17062025-04-30T06:29:41.707ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17072025-04-30T06:29:41.707ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17082025-04-30T06:29:41.708ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17092025-04-30T06:29:41.715ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17102025-04-30T06:29:41.715ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17112025-04-30T06:29:41.717ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17122025-04-30T06:29:41.721ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
17132025-04-30T06:29:41.721ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
17142025-04-30T06:29:41.721ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17152025-04-30T06:29:41.721ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17162025-04-30T06:29:41.722ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17172025-04-30T06:29:41.728ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
17182025-04-30T06:29:41.729ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17192025-04-30T06:29:41.729ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17202025-04-30T06:29:41.730ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17212025-04-30T06:29:41.736ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17222025-04-30T06:29:41.736ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17232025-04-30T06:29:41.736ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17242025-04-30T06:29:41.737ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17252025-04-30T06:29:41.739ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17262025-04-30T06:29:41.746ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17272025-04-30T06:29:41.746ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
17282025-04-30T06:29:41.746ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17292025-04-30T06:29:41.746ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17302025-04-30T06:29:41.747ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17312025-04-30T06:29:41.750ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17322025-04-30T06:29:41.750ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17332025-04-30T06:29:41.751ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17342025-04-30T06:29:41.753ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17352025-04-30T06:29:41.753ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17362025-04-30T06:29:41.753ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17372025-04-30T06:29:41.763ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17382025-04-30T06:29:41.764ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17392025-04-30T06:29:41.764ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17402025-04-30T06:29:41.767ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
17412025-04-30T06:29:41.768ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
17422025-04-30T06:29:41.768ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17432025-04-30T06:29:41.768ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17442025-04-30T06:29:41.768ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17452025-04-30T06:29:41.771ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
17462025-04-30T06:29:41.771ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17472025-04-30T06:29:41.771ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17482025-04-30T06:29:41.772ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17492025-04-30T06:29:41.775ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17502025-04-30T06:29:41.775ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17512025-04-30T06:29:41.775ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17522025-04-30T06:29:41.776ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17532025-04-30T06:29:41.778ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17542025-04-30T06:29:41.785ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
17552025-04-30T06:29:41.786ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
17562025-04-30T06:29:41.786ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
17572025-04-30T06:29:41.786ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
17582025-04-30T06:29:41.786ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17592025-04-30T06:29:41.786ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17602025-04-30T06:29:41.787ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17612025-04-30T06:29:41.793ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
17622025-04-30T06:29:41.793ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17632025-04-30T06:29:41.793ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17642025-04-30T06:29:41.794ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17652025-04-30T06:29:41.799ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17662025-04-30T06:29:41.799ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17672025-04-30T06:29:41.799ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17682025-04-30T06:29:41.800ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17692025-04-30T06:29:41.803ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17702025-04-30T06:29:41.813ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
17712025-04-30T06:29:41.813ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17722025-04-30T06:29:41.813ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17732025-04-30T06:29:41.813ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17742025-04-30T06:29:41.818ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17752025-04-30T06:29:41.818ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17762025-04-30T06:29:41.819ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17772025-04-30T06:29:41.829ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17782025-04-30T06:29:41.829ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17792025-04-30T06:29:41.830ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17802025-04-30T06:29:41.835ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17812025-04-30T06:29:41.835ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17822025-04-30T06:29:41.837ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17832025-04-30T06:29:41.842ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17842025-04-30T06:29:41.842ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17852025-04-30T06:29:41.842ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17862025-04-30T06:29:41.848ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
17872025-04-30T06:29:41.848ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
17882025-04-30T06:29:41.848ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17892025-04-30T06:29:41.848ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17902025-04-30T06:29:41.849ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17912025-04-30T06:29:41.851ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
17922025-04-30T06:29:41.851ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
17932025-04-30T06:29:41.851ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
17942025-04-30T06:29:41.852ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17952025-04-30T06:29:41.853ZINFOtest_image_create (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 11ad27d1-d8a5-479d-a93a-f42ca9630a57
17962025-04-30T06:29:41.853ZDEBGtest_image_create (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 11ad27d1-d8a5-479d-a93a-f42ca9630a57 time_started = 2025-04-30 06:29:40.351676 UTC
17972025-04-30T06:29:41.853ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 5.318360576s iteration = 2 status = {"collection_id":"11ad27d1-d8a5-479d-a93a-f42ca9630a57","time_done":"2025-04-30 06:29:41.349409 UTC","time_started":"2025-04-30 06:29:40.351676 UTC"}
17982025-04-30T06:29:41.853ZDEBGtest_image_create (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
17992025-04-30T06:29:41.853ZWARNtest_image_create (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous reason = no blueprint
18002025-04-30T06:29:41.853ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 29.178\u{b5}s iteration = 2 status = {"error":"no blueprint"}
18012025-04-30T06:29:41.853ZDEBGtest_image_create (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
18022025-04-30T06:29:41.853ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.623\u{b5}s iteration = 2 status = {"error":"task disabled"}
18032025-04-30T06:29:41.856ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18042025-04-30T06:29:41.856ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
18052025-04-30T06:29:41.856ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
18062025-04-30T06:29:41.857ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18072025-04-30T06:29:41.860ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082025-04-30T06:29:41.871ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
18092025-04-30T06:29:41.871ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
18102025-04-30T06:29:41.871ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
18112025-04-30T06:29:41.871ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
18122025-04-30T06:29:41.871ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
18132025-04-30T06:29:41.871ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
18142025-04-30T06:29:41.872ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18152025-04-30T06:29:41.876ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
18162025-04-30T06:29:41.876ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
18172025-04-30T06:29:41.876ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
18182025-04-30T06:29:41.877ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18192025-04-30T06:29:41.881ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18202025-04-30T06:29:41.882ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
18212025-04-30T06:29:41.882ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
18222025-04-30T06:29:41.883ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18232025-04-30T06:29:41.886ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242025-04-30T06:29:41.905ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
18252025-04-30T06:29:41.905ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
18262025-04-30T06:29:41.906ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
18272025-04-30T06:29:41.906ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18282025-04-30T06:29:41.932ZDEBGtest_image_create (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 8cee07a0-1620-440b-87a3-b58086e91df2, kind: Service { id: 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32 }, name: Name("nexus-95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0c14ad1d-9144-4256-88c0-4f554b06a2a8, kind: Service { id: f637f6e2-41d7-4178-936b-513c30d8cbd3 }, name: Name("external-dns-f637f6e2-41d7-4178-936b-513c30d8cbd3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
18292025-04-30T06:29:41.932ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
18302025-04-30T06:29:41.932ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18312025-04-30T06:29:41.935ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
18322025-04-30T06:29:41.935ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
18332025-04-30T06:29:41.936ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18342025-04-30T06:29:41.940ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352025-04-30T06:29:41.948ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
18362025-04-30T06:29:41.948ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
18372025-04-30T06:29:41.948ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
18382025-04-30T06:29:41.949ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18392025-04-30T06:29:41.953ZTRACtest_image_create (nexus): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2025-04-30T06:06:08.248500Z, time_modified: 2025-04-30T06:29:41.596869Z, allowed_ips: None }
18402025-04-30T06:29:41.953ZDEBGtest_image_create (nexus): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
18412025-04-30T06:29:41.954ZDEBGtest_image_create (nexus): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0c14ad1d-9144-4256-88c0-4f554b06a2a8, kind: Service { id: f637f6e2-41d7-4178-936b-513c30d8cbd3 }, name: Name("external-dns-f637f6e2-41d7-4178-936b-513c30d8cbd3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 8cee07a0-1620-440b-87a3-b58086e91df2, kind: Service { id: 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32 }, name: Name("nexus-95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
18422025-04-30T06:29:41.954ZDEBGtest_image_create (nexus): resolved 2 rules for sleds
18432025-04-30T06:29:42.028ZDEBGtest_image_create (nexus): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b6d65341-167c-41df-9b5c-41cded99c229, time_created: 2025-04-30T06:29:35.608735Z, time_modified: 2025-04-30T06:29:35.608735Z }, time_deleted: None, rcgen: Generation(Generation(1)), rack_id: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, is_scrimlet: true, serial_number: "sim-b6d65341", part_number: "Unknown", revision: SqlU32(0), usable_hardware_threads: SqlU32(16), usable_physical_ram: ByteCount(ByteCount(34359738368)), reservoir_size: ByteCount(ByteCount(17179869184)), ip: ::1, port: SqlU16(42828), last_used_address: ::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(35864) }]
18442025-04-30T06:29:42.028ZDEBGtest_image_create (nexus): sending firewall rules to sled agents
18452025-04-30T06:29:42.029ZTRACtest_image_create (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database
18462025-04-30T06:29:42.029ZDEBGtest_image_create (InstanceAllocator): roles roles = RoleSet { roles: {} }
18472025-04-30T06:29:42.029ZDEBGtest_image_create (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
18482025-04-30T06:29:42.033ZTRACtest_image_create (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229, lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
18492025-04-30T06:29:42.033ZTRACtest_image_create (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18502025-04-30T06:29:42.033ZTRACtest_image_create (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database
18512025-04-30T06:29:42.033ZDEBGtest_image_create (InstanceAllocator): roles roles = RoleSet { roles: {} }
18522025-04-30T06:29:42.034ZDEBGtest_image_create (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
18532025-04-30T06:29:42.037ZDEBGtest_image_create (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
18542025-04-30T06:29:42.042ZDEBGtest_image_create (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229, lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
18552025-04-30T06:29:42.090ZDEBGtest_image_create (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:42828/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18562025-04-30T06:29:42.091ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:43454 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
18572025-04-30T06:29:42.091ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = PUT remote_addr = [::1]:43454 req_id = 8155ba20-f2a0-45bf-a7be-1e5ba37ee17e sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18582025-04-30T06:29:42.092ZINFOtest_image_create (dropshot): request completed latency_us = 1144 local_addr = [::1]:42828 method = PUT remote_addr = [::1]:43454 req_id = 8155ba20-f2a0-45bf-a7be-1e5ba37ee17e response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18592025-04-30T06:29:42.093ZDEBGtest_image_create (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:42828/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "8155ba20-f2a0-45bf-a7be-1e5ba37ee17e", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
18602025-04-30T06:29:42.094ZINFOtest_image_create (nexus): updated firewall rules on 1 sleds
18612025-04-30T06:29:42.094ZTRACtest_image_create (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database
18622025-04-30T06:29:42.094ZDEBGtest_image_create (ServiceBalancer): roles roles = RoleSet { roles: {} }
18632025-04-30T06:29:42.095ZDEBGtest_image_create (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
18642025-04-30T06:29:42.095ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
18652025-04-30T06:29:42.095ZDEBGtest_image_create (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18662025-04-30T06:29:42.095ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
18672025-04-30T06:29:42.095ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18682025-04-30T06:29:42.095ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18692025-04-30T06:29:42.095ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
18702025-04-30T06:29:42.095ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
18712025-04-30T06:29:42.095ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
18722025-04-30T06:29:42.096ZDEBGtest_image_create (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18732025-04-30T06:29:42.096ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
18742025-04-30T06:29:42.096ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18752025-04-30T06:29:42.096ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18762025-04-30T06:29:42.096ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
18772025-04-30T06:29:42.096ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
18782025-04-30T06:29:42.096ZDEBGtest_image_create (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
18792025-04-30T06:29:42.096ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet
18802025-04-30T06:29:42.096ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18812025-04-30T06:29:42.097ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
18822025-04-30T06:29:42.097ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18832025-04-30T06:29:42.097ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18842025-04-30T06:29:42.097ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Signaled
18852025-04-30T06:29:42.097ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
18862025-04-30T06:29:42.097ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18872025-04-30T06:29:42.097ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
18882025-04-30T06:29:42.097ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18892025-04-30T06:29:42.098ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18902025-04-30T06:29:42.099ZTRACtest_image_create (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: 57 0c 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 W............_na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:62582 req_id = ed54df25-248d-4f7d-86b4-5baec01394d9
18912025-04-30T06:29:42.100ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 22284,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62582 req_id = ed54df25-248d-4f7d-86b4-5baec01394d9
18922025-04-30T06:29:42.100ZDEBGtest_image_create (store): query key key = _nameservice._tcp
18932025-04-30T06:29:42.100ZDEBGtest_image_create (store): query key key = f424d0e5-39db-489d-9cd8-97cfc1911ae4.host
18942025-04-30T06:29:42.100ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:62582 query = LowerQuery { name: LowerName(Name("_nameservice._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 36192, target: Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal") })) }] req_id = ed54df25-248d-4f7d-86b4-5baec01394d9
18952025-04-30T06:29:42.100ZTRACtest_image_create (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: b9 3e 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 .>..........._ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:54548 req_id = 0f904016-2f0d-490d-9539-ef5785b99a81
18962025-04-30T06:29:42.100ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 47422,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54548 req_id = 0f904016-2f0d-490d-9539-ef5785b99a81
18972025-04-30T06:29:42.101ZDEBGtest_image_create (store): query key key = _external-dns._tcp
18982025-04-30T06:29:42.101ZDEBGtest_image_create (store): query key key = f637f6e2-41d7-4178-936b-513c30d8cbd3.host
18992025-04-30T06:29:42.101ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:54548 query = LowerQuery { name: LowerName(Name("_external-dns._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 59680, target: Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal") })) }] req_id = 0f904016-2f0d-490d-9539-ef5785b99a81
19002025-04-30T06:29:42.102ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
19012025-04-30T06:29:42.102ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19022025-04-30T06:29:42.102ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
19032025-04-30T06:29:42.102ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19042025-04-30T06:29:42.103ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19052025-04-30T06:29:42.103ZTRACtest_image_create (ServiceBalancer): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
19062025-04-30T06:29:42.103ZTRACtest_image_create (ServiceBalancer): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19072025-04-30T06:29:42.103ZTRACtest_image_create (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database
19082025-04-30T06:29:42.103ZDEBGtest_image_create (ServiceBalancer): roles roles = RoleSet { roles: {} }
19092025-04-30T06:29:42.104ZDEBGtest_image_create (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19102025-04-30T06:29:42.105ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 36192, target: Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3446, tv_nsec: 904465351 } })
19112025-04-30T06:29:42.105ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
19122025-04-30T06:29:42.105ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 59680, target: Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3446, tv_nsec: 904881490 } })
19132025-04-30T06:29:42.106ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
19142025-04-30T06:29:42.106ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
19152025-04-30T06:29:42.106ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19162025-04-30T06:29:42.106ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
19172025-04-30T06:29:42.106ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19182025-04-30T06:29:42.107ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19192025-04-30T06:29:42.108ZTRACtest_image_create (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: c9 54 01 00 00 01 00 00 00 00 00 01 24 66 34 32 .T..........$f42\n0010: 34 64 30 65 35 2d 33 39 64 62 2d 34 38 39 64 2d 4d0e5-39db-489d-\n0020: 39 63 64 38 2d 39 37 63 66 63 31 39 31 31 61 65 9cd8-97cfc1911ae\n0030: 34 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 4.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:50336 req_id = 9436d32c-ea8b-4684-927b-e0804e899bb0
19202025-04-30T06:29:42.108ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 51540,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 36,\n 102,\n 52,\n 50,\n 52,\n 100,\n 48,\n 101,\n 53,\n 45,\n 51,\n 57,\n 100,\n 98,\n 45,\n 52,\n 56,\n 57,\n 100,\n 45,\n 57,\n 99,\n 100,\n 56,\n 45,\n 57,\n 55,\n 99,\n 102,\n 99,\n 49,\n 57,\n 49,\n 49,\n 97,\n 101,\n 52,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50336 req_id = 9436d32c-ea8b-4684-927b-e0804e899bb0
19212025-04-30T06:29:42.108ZDEBGtest_image_create (store): query key key = f424d0e5-39db-489d-9cd8-97cfc1911ae4.host
19222025-04-30T06:29:42.109ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:50336 query = LowerQuery { name: LowerName(Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal.")), original: Query { name: Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("f424d0e5-39db-489d-9cd8-97cfc1911ae4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 9436d32c-ea8b-4684-927b-e0804e899bb0
19232025-04-30T06:29:42.109ZTRACtest_image_create (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: de ae 01 00 00 01 00 00 00 00 00 01 24 66 36 33 ............$f63\n0010: 37 66 36 65 32 2d 34 31 64 37 2d 34 31 37 38 2d 7f6e2-41d7-4178-\n0020: 39 33 36 62 2d 35 31 33 63 33 30 64 38 63 62 64 936b-513c30d8cbd\n0030: 33 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 3.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:52749 req_id = c71243e5-7798-45f6-b712-cc2a5d0c993d
19242025-04-30T06:29:42.109ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 57006,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 36,\n 102,\n 54,\n 51,\n 55,\n 102,\n 54,\n 101,\n 50,\n 45,\n 52,\n 49,\n 100,\n 55,\n 45,\n 52,\n 49,\n 55,\n 56,\n 45,\n 57,\n 51,\n 54,\n 98,\n 45,\n 53,\n 49,\n 51,\n 99,\n 51,\n 48,\n 100,\n 56,\n 99,\n 98,\n 100,\n 51,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52749 req_id = c71243e5-7798-45f6-b712-cc2a5d0c993d
19252025-04-30T06:29:42.109ZDEBGtest_image_create (store): query key key = f637f6e2-41d7-4178-936b-513c30d8cbd3.host
19262025-04-30T06:29:42.109ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:52749 query = LowerQuery { name: LowerName(Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal.")), original: Query { name: Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("f637f6e2-41d7-4178-936b-513c30d8cbd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = c71243e5-7798-45f6-b712-cc2a5d0c993d
19272025-04-30T06:29:42.110ZINFOtest_image_create (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:36192] } background_task = dns_servers_internal dns_group = internal
19282025-04-30T06:29:42.110ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 14.469991ms iteration = 2 status = {"addresses":["[::1]:36192"]}
19292025-04-30T06:29:42.110ZINFOtest_image_create (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:59680] } background_task = dns_servers_external dns_group = external
19302025-04-30T06:29:42.110ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 14.007319ms iteration = 2 status = {"addresses":["[::1]:59680"]}
19312025-04-30T06:29:42.110ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
19322025-04-30T06:29:42.110ZWARNtest_image_create (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config
19332025-04-30T06:29:42.110ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 72.625\u{b5}s iteration = 2 status = {"error":"no config"}
19342025-04-30T06:29:42.110ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
19352025-04-30T06:29:42.110ZWARNtest_image_create (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config
19362025-04-30T06:29:42.110ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 13.847\u{b5}s iteration = 2 status = {"error":"no config"}
19372025-04-30T06:29:42.110ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382025-04-30T06:29:42.114ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19392025-04-30T06:29:42.114ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
19402025-04-30T06:29:42.114ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19412025-04-30T06:29:42.115ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19422025-04-30T06:29:42.117ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432025-04-30T06:29:42.122ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
19442025-04-30T06:29:42.122ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
19452025-04-30T06:29:42.122ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19462025-04-30T06:29:42.122ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
19472025-04-30T06:29:42.123ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19482025-04-30T06:29:42.129ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19492025-04-30T06:29:42.132ZDEBGtest_image_create (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19502025-04-30T06:29:42.138ZDEBGtest_image_create (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
19512025-04-30T06:29:42.138ZINFOtest_image_create (nexus): Rack initialized
19522025-04-30T06:29:42.138ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
19532025-04-30T06:29:42.138ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
19542025-04-30T06:29:42.139ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19552025-04-30T06:29:42.139ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19562025-04-30T06:29:42.145ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19572025-04-30T06:29:42.146ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig
19582025-04-30T06:29:42.146ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19592025-04-30T06:29:42.146ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
19602025-04-30T06:29:42.146ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19612025-04-30T06:29:42.147ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19622025-04-30T06:29:42.147ZDEBGtest_image_create (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19632025-04-30T06:29:42.147ZDEBGtest_image_create (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19642025-04-30T06:29:42.147ZDEBGtest_image_create (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19652025-04-30T06:29:42.147ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
19662025-04-30T06:29:42.147ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19672025-04-30T06:29:42.147ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
19682025-04-30T06:29:42.147ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19692025-04-30T06:29:42.148ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19702025-04-30T06:29:42.148ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
19712025-04-30T06:29:42.148ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
19722025-04-30T06:29:42.149ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 00 1f 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:65256 req_id = e0e86582-17b6-4c8a-8e10-2e1be7d3bfab
19732025-04-30T06:29:42.150ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 31,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65256 req_id = e0e86582-17b6-4c8a-8e10-2e1be7d3bfab
19742025-04-30T06:29:42.150ZDEBGtest_image_create (store): query key key = _mgs._tcp
19752025-04-30T06:29:42.150ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
19762025-04-30T06:29:42.150ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:65256 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = e0e86582-17b6-4c8a-8e10-2e1be7d3bfab
19772025-04-30T06:29:42.151ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3446, tv_nsec: 950136898 } })
19782025-04-30T06:29:42.151ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
19792025-04-30T06:29:42.151ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: fc 5a 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .Z..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:52597 req_id = eb5e251f-1f4a-4e3a-8f73-a9776209934d
19802025-04-30T06:29:42.151ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64602,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52597 req_id = eb5e251f-1f4a-4e3a-8f73-a9776209934d
19812025-04-30T06:29:42.152ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
19822025-04-30T06:29:42.152ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:52597 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = eb5e251f-1f4a-4e3a-8f73-a9776209934d
19832025-04-30T06:29:42.199ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
19842025-04-30T06:29:42.199ZDEBGtest_image_create (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19852025-04-30T06:29:42.199ZDEBGtest_image_create (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19862025-04-30T06:29:42.199ZDEBGtest_image_create (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19872025-04-30T06:29:42.199ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
19882025-04-30T06:29:42.199ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19892025-04-30T06:29:42.199ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
19902025-04-30T06:29:42.199ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19912025-04-30T06:29:42.200ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19922025-04-30T06:29:42.202ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 8d 00 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:50794 req_id = a4c94ce4-7d0c-4109-bf96-66f22593b9fa
19932025-04-30T06:29:42.202ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 36096,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50794 req_id = a4c94ce4-7d0c-4109-bf96-66f22593b9fa
19942025-04-30T06:29:42.202ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
19952025-04-30T06:29:42.203ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36096, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:50794 req_id = a4c94ce4-7d0c-4109-bf96-66f22593b9fa
19962025-04-30T06:29:42.203ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19972025-04-30T06:29:42.209ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19982025-04-30T06:29:42.209ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
19992025-04-30T06:29:42.209ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20002025-04-30T06:29:42.210ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20012025-04-30T06:29:42.212ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20022025-04-30T06:29:42.220ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20032025-04-30T06:29:42.221ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
20042025-04-30T06:29:42.221ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20052025-04-30T06:29:42.221ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20062025-04-30T06:29:42.223ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20072025-04-30T06:29:42.231ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20082025-04-30T06:29:42.231ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
20092025-04-30T06:29:42.231ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20102025-04-30T06:29:42.232ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20112025-04-30T06:29:42.233ZDEBGtest_image_create (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20122025-04-30T06:29:42.233ZDEBGtest_image_create (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1606a67f-43dc-428c-b5a4-64158a18add7 dns_zone_name = oxide-dev.test found_so_far = 0 version = 2
20132025-04-30T06:29:42.233ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
20142025-04-30T06:29:42.233ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20152025-04-30T06:29:42.233ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
20162025-04-30T06:29:42.233ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20172025-04-30T06:29:42.234ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20182025-04-30T06:29:42.237ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20192025-04-30T06:29:42.253ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20202025-04-30T06:29:42.258ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database
20212025-04-30T06:29:42.258ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20222025-04-30T06:29:42.259ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20232025-04-30T06:29:42.259ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
20242025-04-30T06:29:42.259ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
20252025-04-30T06:29:42.260ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20262025-04-30T06:29:42.260ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
20272025-04-30T06:29:42.260ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
20282025-04-30T06:29:42.260ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
20292025-04-30T06:29:42.269ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b62ec1-28a9-4c79-bfc1-dd6c264a4a44", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
20302025-04-30T06:29:42.269ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
20312025-04-30T06:29:42.270ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d4e29c7-0e4e-4d5f-a816-f6a97880511c", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
20322025-04-30T06:29:42.270ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
20332025-04-30T06:29:42.272ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "af6b3636-8daf-43be-9a5f-987a45b6326b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
20342025-04-30T06:29:42.272ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
20352025-04-30T06:29:42.274ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f98162-74d3-4008-8bc3-785b29288ae0", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
20362025-04-30T06:29:42.274ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
20372025-04-30T06:29:42.276ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "198ec413-1555-459d-9bf8-59b19dc54626", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
20382025-04-30T06:29:42.276ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
20392025-04-30T06:29:42.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff7c0f45-6c8a-4b1a-836f-dc7ab6da397b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
20402025-04-30T06:29:42.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
20412025-04-30T06:29:42.279ZDEBGtest_image_create (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1606a67f-43dc-428c-b5a4-64158a18add7 dns_zone_name = oxide-dev.test found_so_far = 1 version = 2
20422025-04-30T06:29:42.279ZDEBGtest_image_create (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20432025-04-30T06:29:42.279ZINFOtest_image_create (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external generation = 2
20442025-04-30T06:29:42.279ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 183.361235ms iteration = 2 status = {"generation":2}
20452025-04-30T06:29:42.279ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
20462025-04-30T06:29:42.357ZDEBGtest_image_create (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[::1]:59680 generation = 2 method = PUT servers = DnsServersList { addresses: [[::1]:59680] } uri = http://[::1]:59680/config
20472025-04-30T06:29:42.357ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet
20482025-04-30T06:29:42.357ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20492025-04-30T06:29:42.357ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
20502025-04-30T06:29:42.357ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20512025-04-30T06:29:42.358ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20522025-04-30T06:29:42.358ZDEBGtest_image_create (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20532025-04-30T06:29:42.358ZDEBGtest_image_create (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b7adb783-9175-4a54-8d2b-f67a42c8de3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20542025-04-30T06:29:42.358ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
20552025-04-30T06:29:42.358ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20562025-04-30T06:29:42.359ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
20572025-04-30T06:29:42.359ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20582025-04-30T06:29:42.359ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20592025-04-30T06:29:42.362ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
20602025-04-30T06:29:42.364ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
20612025-04-30T06:29:42.364ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20622025-04-30T06:29:42.365ZINFOtest_image_create (http): accepted connection kind = dns local_addr = [::1]:59680 remote_addr = [::1]:49309
20632025-04-30T06:29:42.366ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20642025-04-30T06:29:42.370ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20652025-04-30T06:29:42.370ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database
20662025-04-30T06:29:42.371ZDEBGtest_image_create (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20672025-04-30T06:29:42.371ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20682025-04-30T06:29:42.372ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692025-04-30T06:29:42.380ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20702025-04-30T06:29:42.381ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database
20712025-04-30T06:29:42.381ZDEBGtest_image_create (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20722025-04-30T06:29:42.381ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20732025-04-30T06:29:42.382ZTRACtest_image_create (http): incoming request kind = dns local_addr = [::1]:59680 method = PUT remote_addr = [::1]:49309 req_id = 1994bc70-33e2-4f01-a78f-fa7928681c7d uri = /config
20742025-04-30T06:29:42.383ZINFOtest_image_create (store): attempting generation update new_generation = 2 req_id = 1994bc70-33e2-4f01-a78f-fa7928681c7d
20752025-04-30T06:29:42.383ZINFOtest_image_create (store): pruning trees for generations newer than 0
20762025-04-30T06:29:42.383ZDEBGtest_image_create (store): creating tree tree_name = generation_2_zone_oxide-dev.test
20772025-04-30T06:29:42.383ZDEBGtest_image_create (store): updating current config
20782025-04-30T06:29:42.383ZDEBGtest_image_create (store): flushing default tree
20792025-04-30T06:29:42.383ZINFOtest_image_create (store): pruning trees for generations older than 2 keep = 3
20802025-04-30T06:29:42.383ZINFOtest_image_create (store): updated generation new_generation = 2 req_id = 1994bc70-33e2-4f01-a78f-fa7928681c7d
20812025-04-30T06:29:42.384ZINFOtest_image_create (http): request completed kind = dns latency_us = 1640 local_addr = [::1]:59680 method = PUT remote_addr = [::1]:49309 req_id = 1994bc70-33e2-4f01-a78f-fa7928681c7d response_code = 204 uri = /config
20822025-04-30T06:29:42.384ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
20832025-04-30T06:29:42.384ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
20842025-04-30T06:29:42.384ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
20852025-04-30T06:29:42.384ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
20862025-04-30T06:29:42.385ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20872025-04-30T06:29:42.385ZDEBGtest_image_create (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:59680 generation = 2 result = Ok(Response { url: "http://[::1]:59680/config", status: 204, headers: {"x-request-id": "1994bc70-33e2-4f01-a78f-fa7928681c7d", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} }) servers = DnsServersList { addresses: [[::1]:59680] }
20882025-04-30T06:29:42.385ZINFOtest_image_create (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:59680 generation = 2 servers = DnsServersList { addresses: [[::1]:59680] }
20892025-04-30T06:29:42.387ZINFOtest_image_create (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external generation = 2 servers = DnsServersList { addresses: [[::1]:59680] }
20902025-04-30T06:29:42.387ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 108.413947ms iteration = 3 status = {"generation":2,"server_results":{"[::1]:59680":{"Ok":null}}}
20912025-04-30T06:29:42.390ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1822f0ee-e42a-41a0-938a-7b79b4d939a2", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
20922025-04-30T06:29:42.390ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
20932025-04-30T06:29:42.392ZDEBGtest_image_create (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b7adb783-9175-4a54-8d2b-f67a42c8de3a dns_zone_name = control-plane.oxide.internal found_so_far = 21 version = 1
20942025-04-30T06:29:42.392ZDEBGtest_image_create (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20952025-04-30T06:29:42.392ZINFOtest_image_create (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal generation = 1
20962025-04-30T06:29:42.392ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 297.144091ms iteration = 2 status = {"generation":1}
20972025-04-30T06:29:42.392ZDEBGtest_image_create (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
20982025-04-30T06:29:42.452ZDEBGtest_image_create (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[::1]:36192 generation = 1 method = PUT servers = DnsServersList { addresses: [[::1]:36192] } uri = http://[::1]:36192/config
20992025-04-30T06:29:42.453ZINFOtest_image_create (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-04-30T06:29:34.012741Z, time_modified: 2025-04-30T06:29:34.012741Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "test-suite-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: 48067caf-f65c-4aea-85c4-070ab101db1b, db_silo: Silo { identity: SiloIdentity { id: 48067caf-f65c-4aea-85c4-070ab101db1b, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2025-04-30T06:29:41.358717Z, time_modified: 2025-04-30T06:29:41.358717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide-dev.test" }, NoSiloCerts { silo_id: 48067caf-f65c-4aea-85c4-070ab101db1b, dns_name: "test-suite-silo.sys.oxide-dev.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 48067caf-f65c-4aea-85c4-070ab101db1b, db_silo: Silo { identity: SiloIdentity { id: 48067caf-f65c-4aea-85c4-070ab101db1b, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2025-04-30T06:29:41.358717Z, time_modified: 2025-04-30T06:29:41.358717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [] }) }
21002025-04-30T06:29:42.453ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 356.579722ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide-dev.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"test-suite-silo.sys.oxide-dev.test":{"silo_id":"48067caf-f65c-4aea-85c4-070ab101db1b","tls_certs":[]}},"default_endpoint":{"silo_id":"48067caf-f65c-4aea-85c4-070ab101db1b","tls_certs":[]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide-dev.test\\" has no usable certificates","silo 48067caf-f65c-4aea-85c4-070ab101db1b with DNS name \\"test-suite-silo.sys.oxide-dev.test\\" has no usable certificates"]}
21012025-04-30T06:29:42.454ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
21022025-04-30T06:29:42.454ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21032025-04-30T06:29:42.454ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21042025-04-30T06:29:42.455ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21052025-04-30T06:29:42.455ZINFOtest_image_create (http): accepted connection kind = dns local_addr = [::1]:36192 remote_addr = [::1]:59518
21062025-04-30T06:29:42.456ZTRACtest_image_create (http): incoming request kind = dns local_addr = [::1]:36192 method = PUT remote_addr = [::1]:59518 req_id = 4cb3d913-d975-4395-9b47-fecb27d8de0d uri = /config
21072025-04-30T06:29:42.457ZINFOtest_image_create (store): attempting generation update new_generation = 1 req_id = 4cb3d913-d975-4395-9b47-fecb27d8de0d
21082025-04-30T06:29:42.458ZINFOtest_image_create (store): updated generation new_generation = 1 req_id = 4cb3d913-d975-4395-9b47-fecb27d8de0d
21092025-04-30T06:29:42.458ZINFOtest_image_create (http): request completed kind = dns latency_us = 1644 local_addr = [::1]:36192 method = PUT remote_addr = [::1]:59518 req_id = 4cb3d913-d975-4395-9b47-fecb27d8de0d response_code = 204 uri = /config
21102025-04-30T06:29:42.459ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "37439e6e-264f-43da-abcf-95f6f618b78a", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21112025-04-30T06:29:42.460ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
21122025-04-30T06:29:42.460ZDEBGtest_image_create (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:36192 generation = 1 result = Ok(Response { url: "http://[::1]:36192/config", status: 204, headers: {"x-request-id": "4cb3d913-d975-4395-9b47-fecb27d8de0d", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} }) servers = DnsServersList { addresses: [[::1]:36192] }
21132025-04-30T06:29:42.460ZINFOtest_image_create (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:36192 generation = 1 servers = DnsServersList { addresses: [[::1]:36192] }
21142025-04-30T06:29:42.463ZINFOtest_image_create (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal generation = 1 servers = DnsServersList { addresses: [[::1]:36192] }
21152025-04-30T06:29:42.463ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 71.199951ms iteration = 3 status = {"generation":1,"server_results":{"[::1]:36192":{"Ok":null}}}
21162025-04-30T06:29:42.464ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21172025-04-30T06:29:42.464ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21182025-04-30T06:29:42.464ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21192025-04-30T06:29:42.464ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21202025-04-30T06:29:42.466ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e814c171-999b-4a49-93ec-c70c93a837bb", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21212025-04-30T06:29:42.467ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
21222025-04-30T06:29:42.468ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21232025-04-30T06:29:42.479ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21242025-04-30T06:29:42.479ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
21252025-04-30T06:29:42.479ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
21262025-04-30T06:29:42.479ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
21272025-04-30T06:29:42.479ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21282025-04-30T06:29:42.479ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21292025-04-30T06:29:42.479ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21302025-04-30T06:29:42.480ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f9d22bb-ffcf-4412-b693-d218dcf508dc", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21312025-04-30T06:29:42.480ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
21322025-04-30T06:29:42.483ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fbf6e92-c603-492a-8c48-092565244444", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21332025-04-30T06:29:42.483ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
21342025-04-30T06:29:42.486ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
21352025-04-30T06:29:42.486ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21362025-04-30T06:29:42.487ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21372025-04-30T06:29:42.488ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21382025-04-30T06:29:42.496ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "092a1b56-5b6b-4880-8d44-19493691b73a", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21392025-04-30T06:29:42.496ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
21402025-04-30T06:29:42.496ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21412025-04-30T06:29:42.496ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21422025-04-30T06:29:42.496ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21432025-04-30T06:29:42.498ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21442025-04-30T06:29:42.509ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452025-04-30T06:29:42.516ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21462025-04-30T06:29:42.517ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21472025-04-30T06:29:42.517ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21482025-04-30T06:29:42.518ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21492025-04-30T06:29:42.521ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "adcee712-7bd4-48b0-9588-e3c1b7fe967a", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21502025-04-30T06:29:42.521ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
21512025-04-30T06:29:42.543ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21522025-04-30T06:29:42.543ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21532025-04-30T06:29:42.544ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21542025-04-30T06:29:42.547ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "80660473-ff82-4281-b83f-3c561307c9b0", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21552025-04-30T06:29:42.547ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
21562025-04-30T06:29:42.550ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21572025-04-30T06:29:42.550ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21582025-04-30T06:29:42.551ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21592025-04-30T06:29:42.554ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21602025-04-30T06:29:42.554ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21612025-04-30T06:29:42.555ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21622025-04-30T06:29:42.558ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "687d514e-8f3e-45fc-9a79-5f0d0f0732d6", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21632025-04-30T06:29:42.559ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
21642025-04-30T06:29:42.559ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
21652025-04-30T06:29:42.559ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
21662025-04-30T06:29:42.559ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21672025-04-30T06:29:42.559ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21682025-04-30T06:29:42.563ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21692025-04-30T06:29:42.567ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
21702025-04-30T06:29:42.568ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21712025-04-30T06:29:42.568ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21722025-04-30T06:29:42.574ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21732025-04-30T06:29:42.579ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21742025-04-30T06:29:42.579ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21752025-04-30T06:29:42.579ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21762025-04-30T06:29:42.580ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21772025-04-30T06:29:42.584ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "27e44858-26e8-440b-bf3e-05e501903bb1", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21782025-04-30T06:29:42.586ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
21792025-04-30T06:29:42.586ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21802025-04-30T06:29:42.595ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21812025-04-30T06:29:42.595ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
21822025-04-30T06:29:42.595ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21832025-04-30T06:29:42.595ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21842025-04-30T06:29:42.597ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21852025-04-30T06:29:42.600ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21862025-04-30T06:29:42.600ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21872025-04-30T06:29:42.601ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21882025-04-30T06:29:42.604ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21892025-04-30T06:29:42.604ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21902025-04-30T06:29:42.605ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21912025-04-30T06:29:42.606ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b6fa32c-89f7-4468-8478-e372cd60c5b7", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21922025-04-30T06:29:42.606ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
21932025-04-30T06:29:42.610ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
21942025-04-30T06:29:42.610ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
21952025-04-30T06:29:42.611ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21962025-04-30T06:29:42.612ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcf493b1-9d9f-40ac-b79d-f69d600ad7d7", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
21972025-04-30T06:29:42.612ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
21982025-04-30T06:29:42.615ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
21992025-04-30T06:29:42.615ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
22002025-04-30T06:29:42.615ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22012025-04-30T06:29:42.615ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22022025-04-30T06:29:42.616ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22032025-04-30T06:29:42.619ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
22042025-04-30T06:29:42.619ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22052025-04-30T06:29:42.619ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22062025-04-30T06:29:42.619ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22072025-04-30T06:29:42.622ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22082025-04-30T06:29:42.622ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22092025-04-30T06:29:42.622ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22102025-04-30T06:29:42.623ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22112025-04-30T06:29:42.624ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc731da6-7db8-45dc-aae1-cc412f1b9e51", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22122025-04-30T06:29:42.624ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
22132025-04-30T06:29:42.626ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22142025-04-30T06:29:42.634ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
22152025-04-30T06:29:42.635ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
22162025-04-30T06:29:42.635ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
22172025-04-30T06:29:42.635ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
22182025-04-30T06:29:42.635ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22192025-04-30T06:29:42.635ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22202025-04-30T06:29:42.636ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22212025-04-30T06:29:42.636ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdc9cb0f-dced-4ed1-a10d-ef53be943eec", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22222025-04-30T06:29:42.636ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
22232025-04-30T06:29:42.638ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "89fbead6-45f1-409f-95b5-efac7230f327", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22242025-04-30T06:29:42.638ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
22252025-04-30T06:29:42.638ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
22262025-04-30T06:29:42.639ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22272025-04-30T06:29:42.639ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22282025-04-30T06:29:42.640ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22292025-04-30T06:29:42.649ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a309a060-135d-481b-aadc-742fd3c8a0d0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22302025-04-30T06:29:42.649ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
22312025-04-30T06:29:42.650ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22322025-04-30T06:29:42.650ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22332025-04-30T06:29:42.650ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22342025-04-30T06:29:42.652ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22352025-04-30T06:29:42.654ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a3c1ad-1d03-4f17-baa0-c37fe431cca1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22362025-04-30T06:29:42.654ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
22372025-04-30T06:29:42.656ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382025-04-30T06:29:42.665ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
22392025-04-30T06:29:42.665ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22402025-04-30T06:29:42.665ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22412025-04-30T06:29:42.666ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22422025-04-30T06:29:42.669ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30b4eca4-913d-4ba4-b867-17f206647f30", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22432025-04-30T06:29:42.669ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
22442025-04-30T06:29:42.670ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22452025-04-30T06:29:42.671ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22462025-04-30T06:29:42.671ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22472025-04-30T06:29:42.676ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22482025-04-30T06:29:42.676ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22492025-04-30T06:29:42.676ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22502025-04-30T06:29:42.679ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73c7613c-4a8c-4d33-a1b8-7f0d2162834c", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22512025-04-30T06:29:42.680ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
22522025-04-30T06:29:42.680ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22532025-04-30T06:29:42.680ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22542025-04-30T06:29:42.680ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22552025-04-30T06:29:42.684ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22562025-04-30T06:29:42.684ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22572025-04-30T06:29:42.685ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22582025-04-30T06:29:42.686ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1563ad0a-04f3-4453-85b5-a9f206c41664", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22592025-04-30T06:29:42.686ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
22602025-04-30T06:29:42.688ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
22612025-04-30T06:29:42.688ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
22622025-04-30T06:29:42.688ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22632025-04-30T06:29:42.688ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22642025-04-30T06:29:42.688ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22652025-04-30T06:29:42.691ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecd545cf-7710-4526-a269-9c3546234716", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22662025-04-30T06:29:42.691ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
22672025-04-30T06:29:42.691ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
22682025-04-30T06:29:42.691ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22692025-04-30T06:29:42.692ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22702025-04-30T06:29:42.692ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22712025-04-30T06:29:42.694ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22722025-04-30T06:29:42.694ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22732025-04-30T06:29:42.694ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22742025-04-30T06:29:42.695ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22752025-04-30T06:29:42.695ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd25ec98-7ed2-4a58-bffb-2aa42f670bbf", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22762025-04-30T06:29:42.695ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
22772025-04-30T06:29:42.698ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22782025-04-30T06:29:42.709ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
22792025-04-30T06:29:42.709ZTRACtest_image_create (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
22802025-04-30T06:29:42.709ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
22812025-04-30T06:29:42.709ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
22822025-04-30T06:29:42.709ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22832025-04-30T06:29:42.709ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22842025-04-30T06:29:42.710ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22852025-04-30T06:29:42.712ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
22862025-04-30T06:29:42.712ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22872025-04-30T06:29:42.712ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22882025-04-30T06:29:42.713ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22892025-04-30T06:29:42.714ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "80a16840-5b6f-4768-a46d-02bb17136ab7", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
22902025-04-30T06:29:42.714ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
22912025-04-30T06:29:42.716ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22922025-04-30T06:29:42.716ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22932025-04-30T06:29:42.716ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22942025-04-30T06:29:42.717ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
22952025-04-30T06:29:42.720ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962025-04-30T06:29:42.729ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
22972025-04-30T06:29:42.729ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
22982025-04-30T06:29:42.729ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
22992025-04-30T06:29:42.730ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23002025-04-30T06:29:42.730ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3396666-8518-4571-a78c-c05c31a8e54d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23012025-04-30T06:29:42.730ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
23022025-04-30T06:29:42.732ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "18e4974e-46c8-4214-ba80-d66210156a4a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23032025-04-30T06:29:42.733ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
23042025-04-30T06:29:42.734ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d4bf864-e739-4eef-aaa9-9c042dbecf64", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23052025-04-30T06:29:42.734ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
23062025-04-30T06:29:42.736ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d110ffbb-521e-427d-8814-90b0807231f4", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23072025-04-30T06:29:42.736ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
23082025-04-30T06:29:42.738ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "64d0955d-0284-4ed4-9d1d-31e9492a004f", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23092025-04-30T06:29:42.739ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
23102025-04-30T06:29:42.740ZDEBGtest_image_create (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 8cee07a0-1620-440b-87a3-b58086e91df2, kind: Service { id: 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32 }, name: Name("nexus-95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0c14ad1d-9144-4256-88c0-4f554b06a2a8, kind: Service { id: f637f6e2-41d7-4178-936b-513c30d8cbd3 }, name: Name("external-dns-f637f6e2-41d7-4178-936b-513c30d8cbd3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
23112025-04-30T06:29:42.740ZTRACtest_image_create (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
23122025-04-30T06:29:42.740ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23132025-04-30T06:29:42.740ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
23142025-04-30T06:29:42.740ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
23152025-04-30T06:29:42.740ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23162025-04-30T06:29:42.743ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23172025-04-30T06:29:42.751ZDEBGtest_image_create (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
23182025-04-30T06:29:42.751ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
23192025-04-30T06:29:42.751ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
23202025-04-30T06:29:42.752ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23212025-04-30T06:29:42.752ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "623617ba-a59c-494a-9f19-5fb6b279f967", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23222025-04-30T06:29:42.753ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
23232025-04-30T06:29:42.756ZTRACtest_image_create (InternalApi): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2025-04-30T06:06:08.248500Z, time_modified: 2025-04-30T06:29:41.596869Z, allowed_ips: None }
23242025-04-30T06:29:42.756ZDEBGtest_image_create (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
23252025-04-30T06:29:42.756ZDEBGtest_image_create (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0c14ad1d-9144-4256-88c0-4f554b06a2a8, kind: Service { id: f637f6e2-41d7-4178-936b-513c30d8cbd3 }, name: Name("external-dns-f637f6e2-41d7-4178-936b-513c30d8cbd3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 8cee07a0-1620-440b-87a3-b58086e91df2, kind: Service { id: 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32 }, name: Name("nexus-95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
23262025-04-30T06:29:42.756ZDEBGtest_image_create (InternalApi): resolved 2 rules for sleds
23272025-04-30T06:29:42.758ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f17c1c00-8f1c-42a0-84f0-2ba788efe6e7", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23282025-04-30T06:29:42.758ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
23292025-04-30T06:29:42.767ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9696da87-cc3d-4602-ac31-89f6c7a6c190", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23302025-04-30T06:29:42.767ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
23312025-04-30T06:29:42.771ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "db751907-51eb-4228-b12b-1b1faa933a5b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23322025-04-30T06:29:42.772ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
23332025-04-30T06:29:42.779ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "220f0cf1-7737-4bc0-8661-ec9625a28fde", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23342025-04-30T06:29:42.779ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
23352025-04-30T06:29:42.783ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "25cb2e9d-0ad5-4ffd-886a-095e172ed350", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23362025-04-30T06:29:42.784ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
23372025-04-30T06:29:42.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f79dafa3-c870-4b57-a029-6626bde8953d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23382025-04-30T06:29:42.786ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
23392025-04-30T06:29:42.788ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aebb60e-e2fd-4309-958d-acf9b0bd2e71", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23402025-04-30T06:29:42.788ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
23412025-04-30T06:29:42.790ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaa26cd9-a484-4f2f-9b57-cabee89f3b30", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23422025-04-30T06:29:42.790ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
23432025-04-30T06:29:42.792ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "91aae227-7cc0-4fa1-a56b-72f2786bd428", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23442025-04-30T06:29:42.793ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
23452025-04-30T06:29:42.796ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "485a4616-2a1c-49d3-92b9-5dbb75c30b24", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23462025-04-30T06:29:42.796ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
23472025-04-30T06:29:42.796ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23482025-04-30T06:29:42.796ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
23492025-04-30T06:29:42.796ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23502025-04-30T06:29:42.797ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23512025-04-30T06:29:42.797ZDEBGtest_image_create (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b6d65341-167c-41df-9b5c-41cded99c229, time_created: 2025-04-30T06:29:35.608735Z, time_modified: 2025-04-30T06:29:35.608735Z }, time_deleted: None, rcgen: Generation(Generation(1)), rack_id: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, is_scrimlet: true, serial_number: "sim-b6d65341", part_number: "Unknown", revision: SqlU32(0), usable_hardware_threads: SqlU32(16), usable_physical_ram: ByteCount(ByteCount(34359738368)), reservoir_size: ByteCount(ByteCount(17179869184)), ip: ::1, port: SqlU16(42828), last_used_address: ::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(35864) }]
23522025-04-30T06:29:42.797ZDEBGtest_image_create (InternalApi): sending firewall rules to sled agents
23532025-04-30T06:29:42.797ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
23542025-04-30T06:29:42.797ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
23552025-04-30T06:29:42.798ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23562025-04-30T06:29:42.800ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23572025-04-30T06:29:42.807ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23582025-04-30T06:29:42.807ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
23592025-04-30T06:29:42.807ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23602025-04-30T06:29:42.807ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
23612025-04-30T06:29:42.807ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23622025-04-30T06:29:42.808ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23632025-04-30T06:29:42.811ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23642025-04-30T06:29:42.816ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23652025-04-30T06:29:42.816ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
23662025-04-30T06:29:42.816ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23672025-04-30T06:29:42.818ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23682025-04-30T06:29:42.818ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229, lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
23692025-04-30T06:29:42.818ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23702025-04-30T06:29:42.818ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
23712025-04-30T06:29:42.818ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
23722025-04-30T06:29:42.819ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23732025-04-30T06:29:42.823ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23742025-04-30T06:29:42.834ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229, lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
23752025-04-30T06:29:42.907ZDEBGtest_image_create (InternalApi): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:42828/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23762025-04-30T06:29:42.965ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
23772025-04-30T06:29:42.965ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
23782025-04-30T06:29:42.968ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:41138 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
23792025-04-30T06:29:42.968ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:65477 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
23802025-04-30T06:29:42.969ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:65477 req_id = 6889d8c8-9077-483c-bff8-65ceda061609 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
23812025-04-30T06:29:42.971ZINFOtest_image_create (dropshot): request completed latency_us = 2180 local_addr = [::1]:42828 method = GET remote_addr = [::1]:65477 req_id = 6889d8c8-9077-483c-bff8-65ceda061609 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
23822025-04-30T06:29:42.972ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = PUT remote_addr = [::1]:41138 req_id = 61484577-4764-4ad2-80bb-0465e504422d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23832025-04-30T06:29:42.972ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "6889d8c8-9077-483c-bff8-65ceda061609", "content-length": "2769", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23842025-04-30T06:29:42.974ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
23852025-04-30T06:29:42.975ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
23862025-04-30T06:29:42.975ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
23872025-04-30T06:29:42.986ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
23882025-04-30T06:29:42.986ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23892025-04-30T06:29:42.986ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
23902025-04-30T06:29:42.986ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23912025-04-30T06:29:42.988ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23922025-04-30T06:29:42.989ZINFOtest_image_create (dropshot): request completed latency_us = 17771 local_addr = [::1]:42828 method = PUT remote_addr = [::1]:41138 req_id = 61484577-4764-4ad2-80bb-0465e504422d response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23932025-04-30T06:29:42.990ZDEBGtest_image_create (InternalApi): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:42828/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "61484577-4764-4ad2-80bb-0465e504422d", "date": "Wed, 30 Apr 2025 06:29:42 GMT"} })
23942025-04-30T06:29:42.993ZINFOtest_image_create (InternalApi): updated firewall rules on 1 sleds
23952025-04-30T06:29:42.994ZINFOtest_image_create (nexus): plumbed initial IP allowlist
23962025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = / versions = all
23972025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /access versions = all
23982025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /assets/{path} versions = all
23992025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /device/auth versions = all
24002025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /device/confirm versions = all
24012025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /device/success versions = all
24022025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /device/token versions = all
24032025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /device/verify versions = all
24042025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /experimental/v1/probes versions = all
24052025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /experimental/v1/probes versions = all
24062025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /experimental/v1/probes/{probe} versions = all
24072025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /experimental/v1/probes/{probe} versions = all
24082025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /experimental/v1/system/support-bundles versions = all
24092025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /experimental/v1/system/support-bundles versions = all
24102025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
24112025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
24122025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
24132025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
24142025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
24152025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
24162025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
24172025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /images versions = all
24182025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /login versions = all
24192025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /login/{silo_name}/local versions = all
24202025-04-30T06:29:43.060ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
24212025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
24222025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
24232025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /lookup/{path} versions = all
24242025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /projects/{path} versions = all
24252025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /projects-new versions = all
24262025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /settings/{path} versions = all
24272025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /system/{path} versions = all
24282025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /utilization versions = all
24292025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/affinity-groups versions = all
24302025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/affinity-groups versions = all
24312025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
24322025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
24332025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
24342025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
24352025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
24362025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
24372025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
24382025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/anti-affinity-groups versions = all
24392025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/anti-affinity-groups versions = all
24402025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
24412025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
24422025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
24432025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
24442025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
24452025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
24462025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
24472025-04-30T06:29:43.061ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/certificates versions = all
24482025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/certificates versions = all
24492025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/certificates/{certificate} versions = all
24502025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/certificates/{certificate} versions = all
24512025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/disks versions = all
24522025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/disks versions = all
24532025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/disks/{disk} versions = all
24542025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/disks/{disk} versions = all
24552025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/disks/{disk}/bulk-write versions = all
24562025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
24572025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
24582025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/disks/{disk}/finalize versions = all
24592025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
24602025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/floating-ips versions = all
24612025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/floating-ips versions = all
24622025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
24632025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/floating-ips/{floating_ip} versions = all
24642025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
24652025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
24662025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
24672025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/groups versions = all
24682025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/groups/{group_id} versions = all
24692025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/images versions = all
24702025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/images versions = all
24712025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/images/{image} versions = all
24722025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/images/{image} versions = all
24732025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/images/{image}/demote versions = all
24742025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/images/{image}/promote versions = all
24752025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances versions = all
24762025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/instances versions = all
24772025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/instances/{instance} versions = all
24782025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance} versions = all
24792025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/instances/{instance} versions = all
24802025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
24812025-04-30T06:29:43.062ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
24822025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance}/disks versions = all
24832025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/instances/{instance}/disks/attach versions = all
24842025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/instances/{instance}/disks/detach versions = all
24852025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance}/external-ips versions = all
24862025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
24872025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
24882025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/instances/{instance}/reboot versions = all
24892025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance}/serial-console versions = all
24902025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
24912025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
24922025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/instances/{instance}/start versions = all
24932025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/instances/{instance}/stop versions = all
24942025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/internet-gateway-ip-addresses versions = all
24952025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/internet-gateway-ip-addresses versions = all
24962025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
24972025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/internet-gateway-ip-pools versions = all
24982025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/internet-gateway-ip-pools versions = all
24992025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
25002025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/internet-gateways versions = all
25012025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/internet-gateways versions = all
25022025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
25032025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/internet-gateways/{gateway} versions = all
25042025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/ip-pools versions = all
25052025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/ip-pools/{pool} versions = all
25062025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/login/{silo_name}/local versions = all
25072025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/logout versions = all
25082025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/me versions = all
25092025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/me/groups versions = all
25102025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/me/ssh-keys versions = all
25112025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/me/ssh-keys versions = all
25122025-04-30T06:29:43.063ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
25132025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
25142025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/metrics/{metric_name} versions = all
25152025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/network-interfaces versions = all
25162025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/network-interfaces versions = all
25172025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/network-interfaces/{interface} versions = all
25182025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/network-interfaces/{interface} versions = all
25192025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/network-interfaces/{interface} versions = all
25202025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/ping versions = all
25212025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/policy versions = all
25222025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/policy versions = all
25232025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/projects versions = all
25242025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/projects versions = all
25252025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/projects/{project} versions = all
25262025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/projects/{project} versions = all
25272025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/projects/{project} versions = all
25282025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/projects/{project}/policy versions = all
25292025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/projects/{project}/policy versions = all
25302025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/snapshots versions = all
25312025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/snapshots versions = all
25322025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/snapshots/{snapshot} versions = all
25332025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/snapshots/{snapshot} versions = all
25342025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/disks versions = all
25352025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
25362025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
25372025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/racks versions = all
25382025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
25392025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/sleds versions = all
25402025-04-30T06:29:43.064ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/hardware/sleds versions = all
25412025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
25422025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
25432025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
25442025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
25452025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
25462025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/switch-port versions = all
25472025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
25482025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
25492025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
25502025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
25512025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
25522025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/switches versions = all
25532025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
25542025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/identity-providers versions = all
25552025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/identity-providers/local/users versions = all
25562025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
25572025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
25582025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/identity-providers/saml versions = all
25592025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
25602025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/ip-pools versions = all
25612025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/ip-pools versions = all
25622025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
25632025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/ip-pools/{pool} versions = all
25642025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/ip-pools/{pool} versions = all
25652025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
25662025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
25672025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
25682025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
25692025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
25702025-04-30T06:29:43.065ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
25712025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
25722025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
25732025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/ip-pools-service versions = all
25742025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/ip-pools-service/ranges versions = all
25752025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
25762025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
25772025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/metrics/{metric_name} versions = all
25782025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/address-lot versions = all
25792025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/networking/address-lot versions = all
25802025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
25812025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
25822025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/allow-list versions = all
25832025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/networking/allow-list versions = all
25842025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/networking/bfd-disable versions = all
25852025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/networking/bfd-enable versions = all
25862025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bfd-status versions = all
25872025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/networking/bgp versions = all
25882025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bgp versions = all
25892025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/networking/bgp versions = all
25902025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bgp-announce-set versions = all
25912025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
25922025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
25932025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
25942025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bgp-exported versions = all
25952025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bgp-message-history versions = all
25962025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
25972025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/bgp-status versions = all
25982025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/loopback-address versions = all
25992025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/networking/loopback-address versions = all
26002025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
26012025-04-30T06:29:43.066ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
26022025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/switch-port-settings versions = all
26032025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/networking/switch-port-settings versions = all
26042025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
26052025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/policy versions = all
26062025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/policy versions = all
26072025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/roles versions = all
26082025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/roles/{role_name} versions = all
26092025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/silo-quotas versions = all
26102025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/silos versions = all
26112025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/silos versions = all
26122025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/system/silos/{silo} versions = all
26132025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/silos/{silo} versions = all
26142025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
26152025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/silos/{silo}/policy versions = all
26162025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/silos/{silo}/policy versions = all
26172025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/silos/{silo}/quotas versions = all
26182025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
26192025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/system/timeseries/query versions = all
26202025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/timeseries/schemas versions = all
26212025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/update/repository versions = all
26222025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/update/repository/{system_version} versions = all
26232025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/update/target-release versions = all
26242025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/system/update/target-release versions = all
26252025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/users versions = all
26262025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/users/{user_id} versions = all
26272025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/users-builtin versions = all
26282025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/users-builtin/{user} versions = all
26292025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/utilization/silos versions = all
26302025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/system/utilization/silos/{silo} versions = all
26312025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/timeseries/query versions = all
26322025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/users versions = all
26332025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/utilization versions = all
26342025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-firewall-rules versions = all
26352025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/vpc-firewall-rules versions = all
26362025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-router-routes versions = all
26372025-04-30T06:29:43.067ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/vpc-router-routes versions = all
26382025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
26392025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-router-routes/{route} versions = all
26402025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/vpc-router-routes/{route} versions = all
26412025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-routers versions = all
26422025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/vpc-routers versions = all
26432025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/vpc-routers/{router} versions = all
26442025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-routers/{router} versions = all
26452025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/vpc-routers/{router} versions = all
26462025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-subnets versions = all
26472025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/vpc-subnets versions = all
26482025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
26492025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-subnets/{subnet} versions = all
26502025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
26512025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
26522025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpcs versions = all
26532025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/vpcs versions = all
26542025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/vpcs/{vpc} versions = all
26552025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/vpcs/{vpc} versions = all
26562025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/vpcs/{vpc} versions = all
26572025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/webhooks/deliveries versions = all
26582025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/webhooks/deliveries/{event_id}/resend versions = all
26592025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/webhooks/event-classes versions = all
26602025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/webhooks/receivers versions = all
26612025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/webhooks/receivers versions = all
26622025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/webhooks/receivers/{receiver} versions = all
26632025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/webhooks/receivers/{receiver} versions = all
26642025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = PUT path = /v1/webhooks/receivers/{receiver} versions = all
26652025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/webhooks/receivers/{receiver}/probe versions = all
26662025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/webhooks/receivers/{receiver}/subscriptions versions = all
26672025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/webhooks/receivers/{receiver}/subscriptions/{subscription} versions = all
26682025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = GET path = /v1/webhooks/secrets versions = all
26692025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = POST path = /v1/webhooks/secrets versions = all
26702025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): registered endpoint local_addr = 127.0.0.1:44375 method = DELETE path = /v1/webhooks/secrets/{secret_id} versions = all
26712025-04-30T06:29:43.068ZINFOtest_image_create (dropshot_external): listening local_addr = 127.0.0.1:44375
26722025-04-30T06:29:43.068ZDEBGtest_image_create (dropshot_external): successfully registered DTrace USDT probes local_addr = 127.0.0.1:44375
26732025-04-30T06:29:43.111ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = / versions = all
26742025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /access versions = all
26752025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /assets/{path} versions = all
26762025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /device/auth versions = all
26772025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /device/confirm versions = all
26782025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /device/success versions = all
26792025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /device/token versions = all
26802025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /device/verify versions = all
26812025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /experimental/v1/probes versions = all
26822025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /experimental/v1/probes versions = all
26832025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /experimental/v1/probes/{probe} versions = all
26842025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /experimental/v1/probes/{probe} versions = all
26852025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /experimental/v1/system/support-bundles versions = all
26862025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /experimental/v1/system/support-bundles versions = all
26872025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
26882025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
26892025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
26902025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
26912025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
26922025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
26932025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
26942025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /images versions = all
26952025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /login versions = all
26962025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /login/{silo_name}/local versions = all
26972025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
26982025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
26992025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
27002025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /lookup/{path} versions = all
27012025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /projects/{path} versions = all
27022025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /projects-new versions = all
27032025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /settings/{path} versions = all
27042025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /system/{path} versions = all
27052025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /utilization versions = all
27062025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/affinity-groups versions = all
27072025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/affinity-groups versions = all
27082025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
27092025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
27102025-04-30T06:29:43.112ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
27112025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
27122025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
27132025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
27142025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
27152025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/anti-affinity-groups versions = all
27162025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/anti-affinity-groups versions = all
27172025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
27182025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
27192025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
27202025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
27212025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
27222025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
27232025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
27242025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/certificates versions = all
27252025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/certificates versions = all
27262025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/certificates/{certificate} versions = all
27272025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/certificates/{certificate} versions = all
27282025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/disks versions = all
27292025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/disks versions = all
27302025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/disks/{disk} versions = all
27312025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/disks/{disk} versions = all
27322025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/disks/{disk}/bulk-write versions = all
27332025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
27342025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
27352025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/disks/{disk}/finalize versions = all
27362025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
27372025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/floating-ips versions = all
27382025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/floating-ips versions = all
27392025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
27402025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/floating-ips/{floating_ip} versions = all
27412025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
27422025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
27432025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
27442025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/groups versions = all
27452025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/groups/{group_id} versions = all
27462025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/images versions = all
27472025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/images versions = all
27482025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/images/{image} versions = all
27492025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/images/{image} versions = all
27502025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/images/{image}/demote versions = all
27512025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/images/{image}/promote versions = all
27522025-04-30T06:29:43.113ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances versions = all
27532025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/instances versions = all
27542025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/instances/{instance} versions = all
27552025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance} versions = all
27562025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/instances/{instance} versions = all
27572025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
27582025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
27592025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance}/disks versions = all
27602025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/instances/{instance}/disks/attach versions = all
27612025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/instances/{instance}/disks/detach versions = all
27622025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance}/external-ips versions = all
27632025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
27642025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
27652025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/instances/{instance}/reboot versions = all
27662025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance}/serial-console versions = all
27672025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
27682025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
27692025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/instances/{instance}/start versions = all
27702025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/instances/{instance}/stop versions = all
27712025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/internet-gateway-ip-addresses versions = all
27722025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/internet-gateway-ip-addresses versions = all
27732025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
27742025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/internet-gateway-ip-pools versions = all
27752025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/internet-gateway-ip-pools versions = all
27762025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
27772025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/internet-gateways versions = all
27782025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/internet-gateways versions = all
27792025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
27802025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/internet-gateways/{gateway} versions = all
27812025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/ip-pools versions = all
27822025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/ip-pools/{pool} versions = all
27832025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/login/{silo_name}/local versions = all
27842025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/logout versions = all
27852025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/me versions = all
27862025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/me/groups versions = all
27872025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/me/ssh-keys versions = all
27882025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/me/ssh-keys versions = all
27892025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
27902025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
27912025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/metrics/{metric_name} versions = all
27922025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/network-interfaces versions = all
27932025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/network-interfaces versions = all
27942025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/network-interfaces/{interface} versions = all
27952025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/network-interfaces/{interface} versions = all
27962025-04-30T06:29:43.114ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/network-interfaces/{interface} versions = all
27972025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/ping versions = all
27982025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/policy versions = all
27992025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/policy versions = all
28002025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/projects versions = all
28012025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/projects versions = all
28022025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/projects/{project} versions = all
28032025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/projects/{project} versions = all
28042025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/projects/{project} versions = all
28052025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/projects/{project}/policy versions = all
28062025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/projects/{project}/policy versions = all
28072025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/snapshots versions = all
28082025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/snapshots versions = all
28092025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/snapshots/{snapshot} versions = all
28102025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/snapshots/{snapshot} versions = all
28112025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/disks versions = all
28122025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
28132025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
28142025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/racks versions = all
28152025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
28162025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/sleds versions = all
28172025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/hardware/sleds versions = all
28182025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
28192025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
28202025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
28212025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
28222025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
28232025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/switch-port versions = all
28242025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
28252025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
28262025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
28272025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
28282025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
28292025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/switches versions = all
28302025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
28312025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/identity-providers versions = all
28322025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/identity-providers/local/users versions = all
28332025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
28342025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
28352025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/identity-providers/saml versions = all
28362025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
28372025-04-30T06:29:43.115ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/ip-pools versions = all
28382025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/ip-pools versions = all
28392025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
28402025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/ip-pools/{pool} versions = all
28412025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/ip-pools/{pool} versions = all
28422025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
28432025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
28442025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
28452025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
28462025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
28472025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
28482025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
28492025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
28502025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/ip-pools-service versions = all
28512025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/ip-pools-service/ranges versions = all
28522025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
28532025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
28542025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/metrics/{metric_name} versions = all
28552025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/address-lot versions = all
28562025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/networking/address-lot versions = all
28572025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
28582025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
28592025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/allow-list versions = all
28602025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/networking/allow-list versions = all
28612025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/networking/bfd-disable versions = all
28622025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/networking/bfd-enable versions = all
28632025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bfd-status versions = all
28642025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/networking/bgp versions = all
28652025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bgp versions = all
28662025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/networking/bgp versions = all
28672025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bgp-announce-set versions = all
28682025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
28692025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
28702025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
28712025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bgp-exported versions = all
28722025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bgp-message-history versions = all
28732025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
28742025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/bgp-status versions = all
28752025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/loopback-address versions = all
28762025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/networking/loopback-address versions = all
28772025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
28782025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
28792025-04-30T06:29:43.116ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/switch-port-settings versions = all
28802025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/networking/switch-port-settings versions = all
28812025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
28822025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/policy versions = all
28832025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/policy versions = all
28842025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/roles versions = all
28852025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/roles/{role_name} versions = all
28862025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/silo-quotas versions = all
28872025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/silos versions = all
28882025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/silos versions = all
28892025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/system/silos/{silo} versions = all
28902025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/silos/{silo} versions = all
28912025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
28922025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/silos/{silo}/policy versions = all
28932025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/silos/{silo}/policy versions = all
28942025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/silos/{silo}/quotas versions = all
28952025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
28962025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/system/timeseries/query versions = all
28972025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/timeseries/schemas versions = all
28982025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/update/repository versions = all
28992025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/update/repository/{system_version} versions = all
29002025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/update/target-release versions = all
29012025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/system/update/target-release versions = all
29022025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/users versions = all
29032025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/users/{user_id} versions = all
29042025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/users-builtin versions = all
29052025-04-30T06:29:43.117ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/users-builtin/{user} versions = all
29062025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/utilization/silos versions = all
29072025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/system/utilization/silos/{silo} versions = all
29082025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/timeseries/query versions = all
29092025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/users versions = all
29102025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/utilization versions = all
29112025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-firewall-rules versions = all
29122025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/vpc-firewall-rules versions = all
29132025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-router-routes versions = all
29142025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/vpc-router-routes versions = all
29152025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
29162025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-router-routes/{route} versions = all
29172025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/vpc-router-routes/{route} versions = all
29182025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-routers versions = all
29192025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/vpc-routers versions = all
29202025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/vpc-routers/{router} versions = all
29212025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-routers/{router} versions = all
29222025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/vpc-routers/{router} versions = all
29232025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-subnets versions = all
29242025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/vpc-subnets versions = all
29252025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
29262025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-subnets/{subnet} versions = all
29272025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
29282025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
29292025-04-30T06:29:43.118ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpcs versions = all
29302025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/vpcs versions = all
29312025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/vpcs/{vpc} versions = all
29322025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/vpcs/{vpc} versions = all
29332025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/vpcs/{vpc} versions = all
29342025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/webhooks/deliveries versions = all
29352025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/webhooks/deliveries/{event_id}/resend versions = all
29362025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/webhooks/event-classes versions = all
29372025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/webhooks/receivers versions = all
29382025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/webhooks/receivers versions = all
29392025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/webhooks/receivers/{receiver} versions = all
29402025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/webhooks/receivers/{receiver} versions = all
29412025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = PUT path = /v1/webhooks/receivers/{receiver} versions = all
29422025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/webhooks/receivers/{receiver}/probe versions = all
29432025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/webhooks/receivers/{receiver}/subscriptions versions = all
29442025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/webhooks/receivers/{receiver}/subscriptions/{subscription} versions = all
29452025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = GET path = /v1/webhooks/secrets versions = all
29462025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = POST path = /v1/webhooks/secrets versions = all
29472025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:35227 method = DELETE path = /v1/webhooks/secrets/{secret_id} versions = all
29482025-04-30T06:29:43.122ZINFOtest_image_create (dropshot_external_techport): listening local_addr = 127.0.0.1:35227
29492025-04-30T06:29:43.122ZDEBGtest_image_create (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = 127.0.0.1:35227
29502025-04-30T06:29:43.122ZDEBGtest_image_create (nexus-producer-server): registered DTrace probes
29512025-04-30T06:29:43.129ZDEBGtest_image_create (dropshot): registered endpoint local_addr = 127.0.0.1:36387 method = GET path = /{producer_id} versions = all
29522025-04-30T06:29:43.129ZINFOtest_image_create (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = 127.0.0.1:36387
29532025-04-30T06:29:43.131ZDEBGtest_image_create (dropshot): successfully registered DTrace USDT probes local_addr = 127.0.0.1:36387
29542025-04-30T06:29:43.131ZDEBGtest_image_create (nexus-producer-server): Requested any available port, Dropshot server has been bound to 127.0.0.1:36387
29552025-04-30T06:29:43.131ZDEBGtest_image_create (nexus-producer-server): Nexus IP provided explicitly, will use it addr = 127.0.0.1:35774
29562025-04-30T06:29:43.131ZDEBGtest_image_create (nexus-producer-server): starting producer registration task
29572025-04-30T06:29:43.131ZINFOtest_image_create (nexus-producer-server): starting oximeter metric producer server address = 127.0.0.1:36387 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
29582025-04-30T06:29:43.131ZDEBGtest_image_create (init_with_steps): Running step start_oximeter
29592025-04-30T06:29:43.131ZDEBGtest_image_create: Starting Oximeter
29602025-04-30T06:29:43.131ZDEBGtest_image_create (oximeter): registered DTrace probes
29612025-04-30T06:29:43.131ZINFOtest_image_create (oximeter): starting oximeter server file = oximeter/collector/src/lib.rs:236
29622025-04-30T06:29:43.131ZDEBGtest_image_create (oximeter): creating ClickHouse client
29632025-04-30T06:29:43.132ZDEBGtest_image_create (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
29642025-04-30T06:29:43.132ZDEBGtest_image_create (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0
29652025-04-30T06:29:43.132ZDEBGtest_image_create (producer-registration-task): will register with Nexus at 127.0.0.1:35774
29662025-04-30T06:29:43.288ZDEBGtest_image_create (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:35774/metrics/producers
29672025-04-30T06:29:43.303ZINFOtest_image_create (dropshot_internal): accepted connection local_addr = 127.0.0.1:35774 remote_addr = 127.0.0.1:64547
29682025-04-30T06:29:43.304ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692025-04-30T06:29:43.310ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
29702025-04-30T06:29:43.310ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
29712025-04-30T06:29:43.311ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
29722025-04-30T06:29:43.311ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
29732025-04-30T06:29:43.316ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:64547 req_id = 68fe03a0-6148-4a84-8df4-c112d0723b9c uri = /metrics/producers
29742025-04-30T06:29:43.320ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:64547 req_id = 68fe03a0-6148-4a84-8df4-c112d0723b9c resource = Database uri = /metrics/producers
29752025-04-30T06:29:43.320ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:64547 req_id = 68fe03a0-6148-4a84-8df4-c112d0723b9c roles = RoleSet { roles: {} } uri = /metrics/producers
29762025-04-30T06:29:43.321ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:64547 req_id = 68fe03a0-6148-4a84-8df4-c112d0723b9c resource = Database result = Ok(()) uri = /metrics/producers
29772025-04-30T06:29:43.324ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = SELECT MAX(value) AS max_version FROM oximeter.version;
29782025-04-30T06:29:43.335ZWARNtest_image_create (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:894 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
29792025-04-30T06:29:43.335ZDEBGtest_image_create (oximeter-agent): oximeter database does not exist, creating collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
29802025-04-30T06:29:43.335ZINFOtest_image_create (clickhouse-client): reading db version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:794 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
29812025-04-30T06:29:43.336ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = SELECT MAX(value) AS max_version FROM oximeter.version;
29822025-04-30T06:29:43.361ZWARNtest_image_create (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:894 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
29832025-04-30T06:29:43.373ZINFOtest_image_create (clickhouse-client): read oximeter database version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:799 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc version = 0
29842025-04-30T06:29:43.373ZINFOtest_image_create (clickhouse-client): initializing oximeter schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:804 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
29852025-04-30T06:29:43.373ZDEBGtest_image_create (clickhouse-client): initializing ClickHouse database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
29862025-04-30T06:29:43.374ZINFOtest_image_create (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 58751 local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:64547 req_id = 68fe03a0-6148-4a84-8df4-c112d0723b9c response_code = 503 uri = /metrics/producers
29872025-04-30T06:29:43.374ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = CREATE DATABASE IF NOT EXISTS oximeter
29882025-04-30T06:29:43.375ZDEBGtest_image_create (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "68fe03a0-6148-4a84-8df4-c112d0723b9c", "content-length": "133", "date": "Wed, 30 Apr 2025 06:29:43 GMT"} })
29892025-04-30T06:29:43.376ZWARNtest_image_create (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 244.408548ms error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"68fe03a0-6148-4a84-8df4-c112d0723b9c\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Wed, 30 Apr 2025 06:29:43 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"68fe03a0-6148-4a84-8df4-c112d0723b9c\\" }" file = oximeter/producer/src/lib.rs:371
29902025-04-30T06:29:43.377ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\n/* The version table contains metadata about the `oximeter` database */\nCREATE TABLE IF NOT EXISTS oximeter.version\n(\n value UInt64,\n timestamp DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (value, timestamp)
29912025-04-30T06:29:43.381ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\n/* The measurement tables contain all individual samples from each timeseries.\n *\n * Each table stores a single datum type, and otherwise contains nearly the same\n * structure. The primary sorting key is on the timeseries name, key, and then\n * timestamp, so that all timeseries from the same schema are grouped, followed\n * by all samples from the same timeseries.\n *\n * This reflects that one usually looks up the _key_ in one or more field table,\n * and then uses that to index quickly into the measurements tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Bool)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
29922025-04-30T06:29:43.384ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
29932025-04-30T06:29:43.386ZTRACtest_image_create (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: 21 92 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 !............_cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:58057 req_id = 2ff48840-cb24-4cba-8c63-fe6bde335334
29942025-04-30T06:29:43.386ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 8594,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58057 req_id = 2ff48840-cb24-4cba-8c63-fe6bde335334
29952025-04-30T06:29:43.386ZDEBGtest_image_create (store): query key key = _crucible-pantry._tcp
29962025-04-30T06:29:43.386ZDEBGtest_image_create (store): query key key = c1e00a1c-93ca-4197-b980-fae75968e6a6.host
29972025-04-30T06:29:43.387ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:58057 query = LowerQuery { name: LowerName(Name("_crucible-pantry._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 62787, target: Name("c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal") })) }] req_id = 2ff48840-cb24-4cba-8c63-fe6bde335334
29982025-04-30T06:29:43.387ZTRACtest_image_create (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 7a 69 01 00 00 01 00 00 00 00 00 01 24 63 31 65 zi..........$c1e\n0010: 30 30 61 31 63 2d 39 33 63 61 2d 34 31 39 37 2d 00a1c-93ca-4197-\n0020: 62 39 38 30 2d 66 61 65 37 35 39 36 38 65 36 61 b980-fae75968e6a\n0030: 36 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 6.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:55386 req_id = c2cd9c48-1d55-417a-8157-488d03276cd5
29992025-04-30T06:29:43.387ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 31337,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 36,\n 99,\n 49,\n 101,\n 48,\n 48,\n 97,\n 49,\n 99,\n 45,\n 57,\n 51,\n 99,\n 97,\n 45,\n 52,\n 49,\n 57,\n 55,\n 45,\n 98,\n 57,\n 56,\n 48,\n 45,\n 102,\n 97,\n 101,\n 55,\n 53,\n 57,\n 54,\n 56,\n 101,\n 54,\n 97,\n 54,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55386 req_id = c2cd9c48-1d55-417a-8157-488d03276cd5
30002025-04-30T06:29:43.387ZDEBGtest_image_create (store): query key key = c1e00a1c-93ca-4197-b980-fae75968e6a6.host
30012025-04-30T06:29:43.387ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:55386 query = LowerQuery { name: LowerName(Name("c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal.")), original: Query { name: Name("c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("c1e00a1c-93ca-4197-b980-fae75968e6a6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = c2cd9c48-1d55-417a-8157-488d03276cd5
30022025-04-30T06:29:43.387ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30032025-04-30T06:29:43.448ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30042025-04-30T06:29:43.448ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:40613 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30052025-04-30T06:29:43.449ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:40613 req_id = 25d77c15-8843-411b-b8ac-81e4fea1652f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30062025-04-30T06:29:43.449ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 361 local_addr = [::1]:62787 method = GET remote_addr = [::1]:40613 req_id = 25d77c15-8843-411b-b8ac-81e4fea1652f response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30072025-04-30T06:29:44.034ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30082025-04-30T06:29:44.037ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:39287 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30092025-04-30T06:29:44.039ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:59245 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30102025-04-30T06:29:44.039ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:62089 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30112025-04-30T06:29:44.039ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:44066 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30122025-04-30T06:29:44.039ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:40305 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30132025-04-30T06:29:44.039ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:49114 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30142025-04-30T06:29:44.039ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:48309 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
30152025-04-30T06:29:44.040ZDEBGtest_image_create (producer-registration-task): will register with Nexus at 127.0.0.1:35774
30162025-04-30T06:29:44.122ZDEBGtest_image_create (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:35774/metrics/producers
30172025-04-30T06:29:44.124ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30182025-04-30T06:29:44.125ZINFOtest_image_create (dropshot_internal): accepted connection local_addr = 127.0.0.1:35774 remote_addr = 127.0.0.1:41466
30192025-04-30T06:29:44.125ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:39287 req_id = 8da93970-7dac-4add-8c63-3037378ef33b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30202025-04-30T06:29:44.125ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:59245 req_id = 576ed04c-39b7-4854-9d2d-5e3dd154f287 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30212025-04-30T06:29:44.125ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:62089 req_id = f6d815e6-b038-4619-9597-57cbced6a426 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30222025-04-30T06:29:44.125ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:44066 req_id = 024cae11-f314-40c9-831a-6e1177fd5229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30232025-04-30T06:29:44.125ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:40305 req_id = c8aa5b36-f2aa-4c83-8af1-07ba0de746d9 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30242025-04-30T06:29:44.129ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:49114 req_id = 2d28f4ce-0336-4b9e-8128-48766c06cf90 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30252025-04-30T06:29:44.138ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:48309 req_id = 2c59bcf0-e1a1-4bba-9b2c-f3f61ff2e684 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30262025-04-30T06:29:44.141ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 16385 local_addr = [::1]:62787 method = GET remote_addr = [::1]:39287 req_id = 8da93970-7dac-4add-8c63-3037378ef33b response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30272025-04-30T06:29:44.141ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 16337 local_addr = [::1]:62787 method = GET remote_addr = [::1]:59245 req_id = 576ed04c-39b7-4854-9d2d-5e3dd154f287 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30282025-04-30T06:29:44.141ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 16297 local_addr = [::1]:62787 method = GET remote_addr = [::1]:62089 req_id = f6d815e6-b038-4619-9597-57cbced6a426 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30292025-04-30T06:29:44.142ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 16285 local_addr = [::1]:62787 method = GET remote_addr = [::1]:44066 req_id = 024cae11-f314-40c9-831a-6e1177fd5229 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30302025-04-30T06:29:44.142ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 16278 local_addr = [::1]:62787 method = GET remote_addr = [::1]:40305 req_id = c8aa5b36-f2aa-4c83-8af1-07ba0de746d9 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30312025-04-30T06:29:44.142ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 12333 local_addr = [::1]:62787 method = GET remote_addr = [::1]:49114 req_id = 2d28f4ce-0336-4b9e-8128-48766c06cf90 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30322025-04-30T06:29:44.142ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 3334 local_addr = [::1]:62787 method = GET remote_addr = [::1]:48309 req_id = 2c59bcf0-e1a1-4bba-9b2c-f3f61ff2e684 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
30332025-04-30T06:29:44.142ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30342025-04-30T06:29:44.146ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:41466 req_id = a4df84ab-51e3-4f50-9a43-78e410a5a67a uri = /metrics/producers
30352025-04-30T06:29:44.148ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:41466 req_id = a4df84ab-51e3-4f50-9a43-78e410a5a67a resource = Database uri = /metrics/producers
30362025-04-30T06:29:44.148ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:41466 req_id = a4df84ab-51e3-4f50-9a43-78e410a5a67a roles = RoleSet { roles: {} } uri = /metrics/producers
30372025-04-30T06:29:44.148ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:41466 req_id = a4df84ab-51e3-4f50-9a43-78e410a5a67a resource = Database result = Ok(()) uri = /metrics/producers
30382025-04-30T06:29:44.150ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30392025-04-30T06:29:44.154ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30402025-04-30T06:29:44.160ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30412025-04-30T06:29:44.165ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30422025-04-30T06:29:44.167ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
30432025-04-30T06:29:44.167ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
30442025-04-30T06:29:44.167ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 2.070303845s iteration = 3 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
30452025-04-30T06:29:44.168ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(String)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30462025-04-30T06:29:44.172ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bytes\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Right now we can't unambiguously record a nullable byte array.\n * Arrays cannot be nested in `Nullable()` types, and encoding the array as\n * a string isn't palatable for a few reasons.\n * See: https://github.com/oxidecomputer/omicron/issues/4551 for more\n * details.\n */\n datum Array(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30472025-04-30T06:29:44.175ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30482025-04-30T06:29:44.183ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30492025-04-30T06:29:44.186ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30502025-04-30T06:29:44.196ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30512025-04-30T06:29:44.200ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Array types cannot be Nullable, see\n * https://clickhouse.com/docs/en/sql-reference/data-types/nullable\n * for more details.\n *\n * This means we need to use empty arrays to indicate a missing value. This\n * is unfortunate, and at this point relies on the fact that an\n * `oximeter::Histogram` cannot have zero bins. If that changes, we'll need\n * to figure out another way to represent missing samples here.\n */\n bins Array(Int8),\n counts Array(UInt64),\n min Int8,\n max Int8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30522025-04-30T06:29:44.208ZINFOtest_image_create (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 61361 local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:41466 req_id = a4df84ab-51e3-4f50-9a43-78e410a5a67a response_code = 503 uri = /metrics/producers
30532025-04-30T06:29:44.208ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt8),\n counts Array(UInt64),\n min UInt8,\n max UInt8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30542025-04-30T06:29:44.212ZDEBGtest_image_create (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "a4df84ab-51e3-4f50-9a43-78e410a5a67a", "content-length": "133", "date": "Wed, 30 Apr 2025 06:29:43 GMT"} })
30552025-04-30T06:29:44.221ZWARNtest_image_create (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 1.088638981s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"a4df84ab-51e3-4f50-9a43-78e410a5a67a\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Wed, 30 Apr 2025 06:29:43 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"a4df84ab-51e3-4f50-9a43-78e410a5a67a\\" }" file = oximeter/producer/src/lib.rs:371
30562025-04-30T06:29:44.221ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int16),\n counts Array(UInt64),\n min Int16,\n max Int16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30572025-04-30T06:29:44.236ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt16),\n counts Array(UInt64),\n min UInt16,\n max UInt16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30582025-04-30T06:29:44.258ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int32),\n counts Array(UInt64),\n min Int32,\n max Int32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30592025-04-30T06:29:44.272ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt32),\n counts Array(UInt64),\n min UInt32,\n max UInt32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30602025-04-30T06:29:44.278ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int64),\n counts Array(UInt64),\n min Int64,\n max Int64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30612025-04-30T06:29:44.284ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt64),\n counts Array(UInt64),\n min UInt64,\n max UInt64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30622025-04-30T06:29:44.300ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float32),\n counts Array(UInt64),\n min Float32,\n max Float32,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30632025-04-30T06:29:44.316ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float64),\n counts Array(UInt64),\n min Float64,\n max Float64,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
30642025-04-30T06:29:44.337ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\n/* The field tables store named dimensions of each timeseries.\n *\n * As with the measurement tables, there is one field table for each field data\n * type. Fields are deduplicated by using the "replacing merge tree", though\n * this behavior **must not** be relied upon for query correctness.\n *\n * The index for the fields differs from the measurements, however. Rows are\n * sorted by timeseries name, then field name, field value, and finally\n * timeseries key. This reflects the most common pattern for looking them up:\n * by field name and possibly value, within a timeseries. The resulting keys are\n * usually then used to look up measurements.\n *\n * NOTE: We may want to consider a secondary index on these tables, sorting by\n * timeseries name and then key, since it would improve lookups where one\n * already has the key. Realistically though, these tables are quite small and\n * so performance benefits will be low in absolute terms.\n *\n * TTL: We use a materialized column to expire old field table records. This\n * column is generated automatically by the database whenever a new row is\n * inserted. It cannot be inserted directly, nor is it returned in a `SELECT *`\n * query. Since these tables are `ReplacingMergeTree`s, that means the last\n * record will remain during a deduplication, which will have the last\n * timestamp. ClickHouse will then expire old data for us, similar to the\n * measurement tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.fields_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Bool,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30652025-04-30T06:29:44.343ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30662025-04-30T06:29:44.346ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30672025-04-30T06:29:44.351ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30682025-04-30T06:29:44.357ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30692025-04-30T06:29:44.364ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30702025-04-30T06:29:44.377ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30712025-04-30T06:29:44.382ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30722025-04-30T06:29:44.386ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30732025-04-30T06:29:44.396ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value IPv6,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30742025-04-30T06:29:44.442ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value String,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30752025-04-30T06:29:44.454ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_uuid\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UUID,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
30762025-04-30T06:29:44.479ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = \n\n/* The timeseries schema table stores the extracted schema for the samples\n * oximeter collects.\n */\nCREATE TABLE IF NOT EXISTS oximeter.timeseries_schema\n(\n timeseries_name String,\n fields Nested(\n name String,\n type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'IpAddr' = 3,\n 'String' = 4,\n 'Uuid' = 6,\n 'I8' = 7,\n 'U8' = 8,\n 'I16' = 9,\n 'U16' = 10,\n 'I32' = 11,\n 'U32' = 12,\n 'U64' = 13\n ),\n source Enum(\n 'Target' = 1,\n 'Metric' = 2\n )\n ),\n datum_type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'F64' = 3,\n 'String' = 4,\n 'Bytes' = 5,\n 'CumulativeI64' = 6,\n 'CumulativeF64' = 7,\n 'HistogramI64' = 8,\n 'HistogramF64' = 9,\n 'I8' = 10,\n 'U8' = 11,\n 'I16' = 12,\n 'U16' = 13,\n 'I32' = 14,\n 'U32' = 15,\n 'U64' = 16,\n 'F32' = 17,\n 'CumulativeU64' = 18,\n 'CumulativeF32' = 19,\n 'HistogramI8' = 20,\n 'HistogramU8' = 21,\n 'HistogramI16' = 22,\n 'HistogramU16' = 23,\n 'HistogramI32' = 24,\n 'HistogramU32' = 25,\n 'HistogramU64' = 26,\n 'HistogramF32' = 27\n ),\n created DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, fields.name)
30772025-04-30T06:29:44.502ZINFOtest_image_create (clickhouse-client): inserting current version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:825 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc version = 14
30782025-04-30T06:29:44.502ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = INSERT INTO oximeter.version (*) VALUES (14, now());
30792025-04-30T06:29:44.509ZDEBGtest_image_create (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2064b1d7-907e-4f7e-876a-a023e3cf1a8b
30802025-04-30T06:29:44.510ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:45963 method = GET path = /info versions = all
30812025-04-30T06:29:44.510ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:45963 method = GET path = /producers versions = all
30822025-04-30T06:29:44.510ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:45963 method = DELETE path = /producers/{producer_id} versions = all
30832025-04-30T06:29:44.510ZDEBGtest_image_create (dropshot): registered endpoint local_addr = [::1]:45963 method = GET path = /producers/{producer_id} versions = all
30842025-04-30T06:29:44.510ZINFOtest_image_create (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [::1]:45963
30852025-04-30T06:29:44.511ZDEBGtest_image_create (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:45963
30862025-04-30T06:29:44.512ZDEBGtest_image_create (oximeter): registered USDT probes
30872025-04-30T06:29:44.512ZDEBGtest_image_create (oximeter): contacting nexus
30882025-04-30T06:29:45.212ZDEBGtest_image_create (oximeter): client request body = Some(Body) method = POST uri = http://127.0.0.1:35774/metrics/collectors
30892025-04-30T06:29:45.213ZDEBGtest_image_create (producer-registration-task): will register with Nexus at 127.0.0.1:35774
30902025-04-30T06:29:45.269ZDEBGtest_image_create (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:35774/metrics/producers
30912025-04-30T06:29:45.274ZINFOtest_image_create (dropshot_internal): accepted connection local_addr = 127.0.0.1:35774 remote_addr = 127.0.0.1:46899
30922025-04-30T06:29:45.274ZINFOtest_image_create (dropshot_internal): accepted connection local_addr = 127.0.0.1:35774 remote_addr = 127.0.0.1:53107
30932025-04-30T06:29:45.275ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53107 req_id = 736fd243-93de-4d1d-b0a9-e74dd54f848b uri = /metrics/producers
30942025-04-30T06:29:45.280ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53107 req_id = 736fd243-93de-4d1d-b0a9-e74dd54f848b resource = Database uri = /metrics/producers
30952025-04-30T06:29:45.280ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53107 req_id = 736fd243-93de-4d1d-b0a9-e74dd54f848b roles = RoleSet { roles: {} } uri = /metrics/producers
30962025-04-30T06:29:45.281ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53107 req_id = 736fd243-93de-4d1d-b0a9-e74dd54f848b resource = Database result = Ok(()) uri = /metrics/producers
30972025-04-30T06:29:45.282ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:46899 req_id = 6e9396aa-0258-48e5-9263-483de4d3a0b2 uri = /metrics/collectors
30982025-04-30T06:29:45.283ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:46899 req_id = 6e9396aa-0258-48e5-9263-483de4d3a0b2 resource = Database uri = /metrics/collectors
30992025-04-30T06:29:45.283ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:46899 req_id = 6e9396aa-0258-48e5-9263-483de4d3a0b2 roles = RoleSet { roles: {} } uri = /metrics/collectors
31002025-04-30T06:29:45.283ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:46899 req_id = 6e9396aa-0258-48e5-9263-483de4d3a0b2 resource = Database result = Ok(()) uri = /metrics/collectors
31012025-04-30T06:29:45.288ZINFOtest_image_create (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 12704 local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53107 req_id = 736fd243-93de-4d1d-b0a9-e74dd54f848b response_code = 503 uri = /metrics/producers
31022025-04-30T06:29:45.289ZDEBGtest_image_create (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "736fd243-93de-4d1d-b0a9-e74dd54f848b", "content-length": "133", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
31032025-04-30T06:29:45.291ZWARNtest_image_create (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 2.15887698s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"736fd243-93de-4d1d-b0a9-e74dd54f848b\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Wed, 30 Apr 2025 06:29:45 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"736fd243-93de-4d1d-b0a9-e74dd54f848b\\" }" file = oximeter/producer/src/lib.rs:371
31042025-04-30T06:29:45.291ZINFOtest_image_create (nexus): registered new oximeter metric collection server address = [::1]:45963 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
31052025-04-30T06:29:45.292ZINFOtest_image_create (dropshot_internal): request completed latency_us = 9624 local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:46899 req_id = 6e9396aa-0258-48e5-9263-483de4d3a0b2 response_code = 204 uri = /metrics/collectors
31062025-04-30T06:29:45.300ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors", status: 204, headers: {"x-request-id": "6e9396aa-0258-48e5-9263-483de4d3a0b2", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
31072025-04-30T06:29:45.300ZINFOtest_image_create (oximeter): oximeter registered with nexus file = oximeter/collector/src/lib.rs:392 id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
31082025-04-30T06:29:45.300ZDEBGtest_image_create (init_with_steps): Running step start_producer_server
31092025-04-30T06:29:45.300ZDEBGtest_image_create: Starting test metric Producer Server
31102025-04-30T06:29:45.303ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = GET path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31112025-04-30T06:29:45.303ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = POST path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31122025-04-30T06:29:45.303ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = DELETE path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31132025-04-30T06:29:45.303ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = GET path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31142025-04-30T06:29:45.304ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = GET path = /crucible/0/regions/{id}/snapshots server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31152025-04-30T06:29:45.304ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31162025-04-30T06:29:45.304ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = GET path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31172025-04-30T06:29:45.304ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31182025-04-30T06:29:45.304ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36512 method = POST path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
31192025-04-30T06:29:45.304ZINFOtest_image_create (Simulated CrucibleAgent Dropshot Server): listening kind = storage local_addr = [::1]:36512 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
31202025-04-30T06:29:45.304ZDEBGtest_image_create (Simulated CrucibleAgent Dropshot Server): successfully registered DTrace USDT probes kind = storage local_addr = [::1]:36512 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
31212025-04-30T06:29:45.304ZINFOtest_image_create (SledAgent): Created Simulated Crucible Server address = [::1]:36512 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
31222025-04-30T06:29:45.304ZINFOtest_image_create (nexus): inserting test physical disk model = test-model physical_disk_id = 6768247e-b674-48a2-a509-fdc8818e0642 serial = totally-unique-serial: 6768247e-b674-48a2-a509-fdc8818e0642 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
31232025-04-30T06:29:45.304ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31242025-04-30T06:29:45.304ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31252025-04-30T06:29:45.305ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31262025-04-30T06:29:45.305ZINFOtest_image_create (oximeter-agent): starting refresh list task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:559
31272025-04-30T06:29:45.376ZINFOtest_image_create (dropshot_internal): accepted connection local_addr = 127.0.0.1:35774 remote_addr = 127.0.0.1:47473
31282025-04-30T06:29:45.376ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
31292025-04-30T06:29:45.381ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
31302025-04-30T06:29:45.382ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 330304e3-108a-4239-8df8-0e11bf2f5b57 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
31312025-04-30T06:29:45.383ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:47473 req_id = b3044d02-fb0a-43c3-a51b-199e3d60ebfa uri = /metrics/producers
31322025-04-30T06:29:45.383ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 330304e3-108a-4239-8df8-0e11bf2f5b57 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
31332025-04-30T06:29:45.384ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 330304e3-108a-4239-8df8-0e11bf2f5b57 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
31342025-04-30T06:29:45.385ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 330304e3-108a-4239-8df8-0e11bf2f5b57 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
31352025-04-30T06:29:45.385ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:47473 req_id = b3044d02-fb0a-43c3-a51b-199e3d60ebfa resource = Database uri = /metrics/producers
31362025-04-30T06:29:45.385ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:47473 req_id = b3044d02-fb0a-43c3-a51b-199e3d60ebfa roles = RoleSet { roles: {} } uri = /metrics/producers
31372025-04-30T06:29:45.386ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:47473 req_id = b3044d02-fb0a-43c3-a51b-199e3d60ebfa resource = Database result = Ok(()) uri = /metrics/producers
31382025-04-30T06:29:45.386ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31392025-04-30T06:29:45.386ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31402025-04-30T06:29:45.387ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31412025-04-30T06:29:45.400ZINFOtest_image_create (dropshot_internal): request completed latency_us = 17335 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 330304e3-108a-4239-8df8-0e11bf2f5b57 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
31422025-04-30T06:29:45.401ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "330304e3-108a-4239-8df8-0e11bf2f5b57", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
31432025-04-30T06:29:45.401ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 0 n_pruned_tasks = 0
31442025-04-30T06:29:45.401ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
31452025-04-30T06:29:45.401ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
31462025-04-30T06:29:45.402ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31472025-04-30T06:29:45.402ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31482025-04-30T06:29:45.402ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31492025-04-30T06:29:45.405ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31502025-04-30T06:29:45.413ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
31512025-04-30T06:29:45.414ZINFOtest_image_create (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
31522025-04-30T06:29:45.415ZINFOtest_image_create (dropshot_internal): request completed latency_us = 31694 local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:47473 req_id = b3044d02-fb0a-43c3-a51b-199e3d60ebfa response_code = 201 uri = /metrics/producers
31532025-04-30T06:29:45.514ZTRACtest_image_create (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
31542025-04-30T06:29:45.515ZTRACtest_image_create (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
31552025-04-30T06:29:45.543ZINFOtest_image_create (nexus): upserting zpool physical_disk_id = 6768247e-b674-48a2-a509-fdc8818e0642 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 31016af4-c042-4f1b-b2e5-da29ac91366e
31562025-04-30T06:29:45.543ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31572025-04-30T06:29:45.543ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31582025-04-30T06:29:45.544ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31592025-04-30T06:29:45.546ZTRACtest_image_create (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
31602025-04-30T06:29:45.546ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
31612025-04-30T06:29:45.546ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31622025-04-30T06:29:45.546ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31632025-04-30T06:29:45.546ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31642025-04-30T06:29:45.554ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31652025-04-30T06:29:45.561ZDEBGtest_image_create (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
31662025-04-30T06:29:45.581ZINFOtest_image_create (nexus): upserting Crucible dataset dataset_id = 10ce5847-bfe2-4b36-b3bd-b4e948fe0332 zpool_id = 31016af4-c042-4f1b-b2e5-da29ac91366e
31672025-04-30T06:29:45.592ZINFOtest_image_create (nexus): inserting test physical disk model = test-model physical_disk_id = 6768247e-b674-48a2-a509-fdc8818e0642 serial = totally-unique-serial: 6768247e-b674-48a2-a509-fdc8818e0642 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
31682025-04-30T06:29:45.592ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31692025-04-30T06:29:45.592ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31702025-04-30T06:29:45.593ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31712025-04-30T06:29:45.602ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = PhysicalDisk { parent: Fleet, key: 6768247e-b674-48a2-a509-fdc8818e0642 (physical_disk), lookup_type: ById(6768247e-b674-48a2-a509-fdc8818e0642) }
31722025-04-30T06:29:45.603ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
31732025-04-30T06:29:45.603ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31742025-04-30T06:29:45.603ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31752025-04-30T06:29:45.603ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31762025-04-30T06:29:45.606ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31772025-04-30T06:29:45.615ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = PhysicalDisk { parent: Fleet, key: 6768247e-b674-48a2-a509-fdc8818e0642 (physical_disk), lookup_type: ById(6768247e-b674-48a2-a509-fdc8818e0642) } result = Ok(())
31782025-04-30T06:29:45.615ZINFOtest_image_create (nexus): upserting zpool physical_disk_id = 6768247e-b674-48a2-a509-fdc8818e0642 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 31016af4-c042-4f1b-b2e5-da29ac91366e
31792025-04-30T06:29:45.616ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31802025-04-30T06:29:45.616ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31812025-04-30T06:29:45.616ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31822025-04-30T06:29:45.618ZTRACtest_image_create (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
31832025-04-30T06:29:45.618ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
31842025-04-30T06:29:45.618ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31852025-04-30T06:29:45.618ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31862025-04-30T06:29:45.619ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31872025-04-30T06:29:45.664ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31882025-04-30T06:29:45.668ZDEBGtest_image_create (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
31892025-04-30T06:29:45.676ZTRACtest_image_create (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet
31902025-04-30T06:29:45.676ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
31912025-04-30T06:29:45.676ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31922025-04-30T06:29:45.676ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31932025-04-30T06:29:45.680ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31942025-04-30T06:29:45.683ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31952025-04-30T06:29:45.686ZDEBGtest_image_create (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
31962025-04-30T06:29:45.686ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
31972025-04-30T06:29:45.686ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
31982025-04-30T06:29:45.686ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
31992025-04-30T06:29:45.693ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
32002025-04-30T06:29:45.693ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
32012025-04-30T06:29:45.693ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
32022025-04-30T06:29:45.693ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
32032025-04-30T06:29:45.697ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
32042025-04-30T06:29:45.697ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Signaled
32052025-04-30T06:29:45.697ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
32062025-04-30T06:29:45.697ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
32072025-04-30T06:29:45.697ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
32082025-04-30T06:29:45.697ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32092025-04-30T06:29:45.698ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32102025-04-30T06:29:45.701ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32112025-04-30T06:29:45.710ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
32122025-04-30T06:29:45.711ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
32132025-04-30T06:29:45.711ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
32142025-04-30T06:29:45.711ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
32152025-04-30T06:29:45.713ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32162025-04-30T06:29:45.719ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
32172025-04-30T06:29:45.719ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
32182025-04-30T06:29:45.719ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32192025-04-30T06:29:45.720ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32202025-04-30T06:29:45.722ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
32212025-04-30T06:29:45.722ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
32222025-04-30T06:29:45.723ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
32232025-04-30T06:29:45.727ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
32242025-04-30T06:29:45.728ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
32252025-04-30T06:29:45.729ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: c5 9a 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:52651 req_id = b4b006fe-3848-4f02-a7b1-abffac84a05f
32262025-04-30T06:29:45.729ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 50586,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52651 req_id = b4b006fe-3848-4f02-a7b1-abffac84a05f
32272025-04-30T06:29:45.729ZDEBGtest_image_create (store): query key key = _mgs._tcp
32282025-04-30T06:29:45.729ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
32292025-04-30T06:29:45.730ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:52651 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = b4b006fe-3848-4f02-a7b1-abffac84a05f
32302025-04-30T06:29:45.731ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3450, tv_nsec: 529889090 } })
32312025-04-30T06:29:45.731ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
32322025-04-30T06:29:45.731ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: d4 a6 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:63106 req_id = a966cd6e-24b6-475d-810d-6dba201d71be
32332025-04-30T06:29:45.731ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 54438,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63106 req_id = a966cd6e-24b6-475d-810d-6dba201d71be
32342025-04-30T06:29:45.731ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
32352025-04-30T06:29:45.731ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:63106 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = a966cd6e-24b6-475d-810d-6dba201d71be
32362025-04-30T06:29:45.821ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
32372025-04-30T06:29:45.823ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 08 d5 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:65319 req_id = f57f2ed2-f075-4273-b927-47c48bd52b37
32382025-04-30T06:29:45.823ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2261,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65319 req_id = f57f2ed2-f075-4273-b927-47c48bd52b37
32392025-04-30T06:29:45.829ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
32402025-04-30T06:29:45.830ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2261, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:65319 req_id = f57f2ed2-f075-4273-b927-47c48bd52b37
32412025-04-30T06:29:45.835ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
32422025-04-30T06:29:45.836ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
32432025-04-30T06:29:45.837ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
32442025-04-30T06:29:45.852ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "35e86986-5925-4ad1-a969-96c8891be171", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32452025-04-30T06:29:45.852ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
32462025-04-30T06:29:45.855ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "86061d1a-2fc1-4bd8-8a56-abf0a47411fc", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32472025-04-30T06:29:45.856ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
32482025-04-30T06:29:45.859ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a75aa5fd-3f7c-4fc7-ba2d-e8d6aab9901b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32492025-04-30T06:29:45.859ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
32502025-04-30T06:29:45.862ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6d37981-a87e-4181-9522-c6768ccc12df", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32512025-04-30T06:29:45.864ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
32522025-04-30T06:29:45.868ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "239182b2-ffe4-4ee8-a229-5f42644bf29a", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32532025-04-30T06:29:45.868ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
32542025-04-30T06:29:45.874ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8d246fb-f5dc-4570-8d1d-8ce14af9e41b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32552025-04-30T06:29:45.874ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
32562025-04-30T06:29:45.885ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1edbbf1-b65d-437b-b602-c4e753e40c49", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32572025-04-30T06:29:45.885ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
32582025-04-30T06:29:45.887ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "82ac470c-3569-48bd-84c6-50271d1a39d1", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32592025-04-30T06:29:45.888ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
32602025-04-30T06:29:45.889ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "15280267-9b14-444a-a71b-06bdededf9fc", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32612025-04-30T06:29:45.889ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
32622025-04-30T06:29:45.890ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "663aa4d9-b742-4f45-a066-9fb6cb003a3b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32632025-04-30T06:29:45.890ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
32642025-04-30T06:29:45.894ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
32652025-04-30T06:29:45.895ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebdf4130-4edc-4c1f-91f1-a58628f84dec", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32662025-04-30T06:29:45.895ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
32672025-04-30T06:29:45.899ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0269096b-58ff-4f98-b23e-114de27a613e", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32682025-04-30T06:29:45.899ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
32692025-04-30T06:29:45.902ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac064f3a-7c57-4e9f-b09e-9f8118066b1f", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32702025-04-30T06:29:45.902ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
32712025-04-30T06:29:45.907ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cceb68c3-60dd-4b26-a3a1-2ca4694e1317", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32722025-04-30T06:29:45.908ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
32732025-04-30T06:29:45.910ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "020b7c3a-4fc8-44a6-912d-d0b57ecc4ecc", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32742025-04-30T06:29:45.910ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
32752025-04-30T06:29:45.911ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "88c4fd1b-a1fd-4f28-8dbf-fda4b953d43f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32762025-04-30T06:29:45.912ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
32772025-04-30T06:29:45.913ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3ef0fa6-9648-4c76-808e-9caef2cec76b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32782025-04-30T06:29:45.914ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
32792025-04-30T06:29:45.916ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3d05cb4-5caa-4ee2-bf7c-bff1368970e8", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32802025-04-30T06:29:45.916ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
32812025-04-30T06:29:45.919ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e9726ee-5c9b-4441-9d44-b4e95223c5d5", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32822025-04-30T06:29:45.919ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
32832025-04-30T06:29:45.920ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3a000d2-4088-4c09-b4b5-7b4aa0a4a6d4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32842025-04-30T06:29:45.920ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
32852025-04-30T06:29:45.921ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "83fe21b5-5499-433d-b355-90c749bacdf3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32862025-04-30T06:29:45.921ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
32872025-04-30T06:29:45.922ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "66364b1f-d4de-4320-9a7d-b8eded086099", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32882025-04-30T06:29:45.922ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
32892025-04-30T06:29:45.923ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3b4b54c-0adc-4463-be99-74f591277bab", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32902025-04-30T06:29:45.923ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
32912025-04-30T06:29:45.925ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d02edd1b-1340-4a07-bc74-9468dd2937e1", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32922025-04-30T06:29:45.926ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
32932025-04-30T06:29:45.934ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf78e106-c226-4630-816d-9b97f674dffd", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32942025-04-30T06:29:45.934ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
32952025-04-30T06:29:45.936ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38914e51-8f12-47b1-8b52-568e9e0167d1", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32962025-04-30T06:29:45.936ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
32972025-04-30T06:29:45.939ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "77c2fd3b-285f-4f8a-870e-3970a938fe75", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
32982025-04-30T06:29:45.939ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
32992025-04-30T06:29:45.945ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
33002025-04-30T06:29:45.945ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
33012025-04-30T06:29:45.945ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
33022025-04-30T06:29:45.945ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
33032025-04-30T06:29:45.946ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
33042025-04-30T06:29:45.953ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "47a8ec0e-2a91-4b04-a061-aa01df78b272", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33052025-04-30T06:29:45.956ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
33062025-04-30T06:29:45.963ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33072025-04-30T06:29:45.972ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
33082025-04-30T06:29:45.972ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
33092025-04-30T06:29:45.972ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
33102025-04-30T06:29:45.973ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
33112025-04-30T06:29:45.976ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
33122025-04-30T06:29:45.976ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
33132025-04-30T06:29:45.977ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
33142025-04-30T06:29:45.980ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd588687-bed2-4b86-bd2b-a8d62fe72e65", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33152025-04-30T06:29:45.981ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
33162025-04-30T06:29:45.987ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2540b67a-92a3-4efc-b676-36ed1fe08a11", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33172025-04-30T06:29:45.987ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
33182025-04-30T06:29:45.990ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b21f8b0-4652-4a57-8932-cbe708ffae6d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33192025-04-30T06:29:45.991ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
33202025-04-30T06:29:45.993ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c580e44f-0f25-40e3-aed3-8469ed2d6789", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33212025-04-30T06:29:45.993ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
33222025-04-30T06:29:45.995ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac908f7b-e6e8-4ea2-8419-6138e92906ff", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33232025-04-30T06:29:45.995ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
33242025-04-30T06:29:45.997ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "30401c2f-8a5d-4c8d-abba-db1fbae329d1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33252025-04-30T06:29:45.998ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
33262025-04-30T06:29:45.999ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f98d7bc-e0e1-415b-aa6c-8ae3f3dc2187", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33272025-04-30T06:29:46.000ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
33282025-04-30T06:29:46.013ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b6a9085-fad3-4c01-bdf5-0d2bcea9a39c", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33292025-04-30T06:29:46.014ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
33302025-04-30T06:29:46.026ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa5ed7e9-0c9a-4e80-8ac3-3a63de40b695", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33312025-04-30T06:29:46.026ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
33322025-04-30T06:29:46.032ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "530925fb-ee7f-45cc-9ded-b98c8e9a5786", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33332025-04-30T06:29:46.032ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
33342025-04-30T06:29:46.044ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
33352025-04-30T06:29:46.047ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "87378e0a-c2ab-4973-9230-906622ab0d7b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33362025-04-30T06:29:46.047ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
33372025-04-30T06:29:46.050ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "050202f5-f286-4417-8a2f-4a5e82747f1e", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33382025-04-30T06:29:46.050ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
33392025-04-30T06:29:46.052ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2a206b0-2fa9-465b-af5e-57bc8bffa930", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33402025-04-30T06:29:46.053ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
33412025-04-30T06:29:46.054ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea00cd14-4ce0-49e3-94e9-d06487f9ae30", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33422025-04-30T06:29:46.054ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
33432025-04-30T06:29:46.056ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9d4dac8-457c-435e-aed8-2e7efe0204b1", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33442025-04-30T06:29:46.056ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
33452025-04-30T06:29:46.057ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "881a9e33-8740-4f09-a15d-c1161dd16d66", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33462025-04-30T06:29:46.057ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
33472025-04-30T06:29:46.059ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "48b0c05a-92a9-46fe-9d43-a40f2eca02fa", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33482025-04-30T06:29:46.059ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
33492025-04-30T06:29:46.059ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
33502025-04-30T06:29:46.059ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
33512025-04-30T06:29:46.059ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33522025-04-30T06:29:46.060ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33532025-04-30T06:29:46.064ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542025-04-30T06:29:46.068ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
33552025-04-30T06:29:46.069ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
33562025-04-30T06:29:46.069ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
33572025-04-30T06:29:46.069ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
33582025-04-30T06:29:46.069ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33592025-04-30T06:29:46.069ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33602025-04-30T06:29:46.071ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33612025-04-30T06:29:46.076ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
33622025-04-30T06:29:46.076ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
33632025-04-30T06:29:46.077ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33642025-04-30T06:29:46.077ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33652025-04-30T06:29:46.151ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
33662025-04-30T06:29:46.151ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
33672025-04-30T06:29:46.152ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
33682025-04-30T06:29:46.152ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
33692025-04-30T06:29:46.152ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
33702025-04-30T06:29:46.152ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
33712025-04-30T06:29:46.153ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
33722025-04-30T06:29:46.153ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:62529 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
33732025-04-30T06:29:46.153ZDEBGtest_image_create (producer-registration-task): will register with Nexus at 127.0.0.1:35774
33742025-04-30T06:29:46.206ZDEBGtest_image_create (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:35774/metrics/producers
33752025-04-30T06:29:46.207ZINFOtest_image_create (dropshot_internal): accepted connection local_addr = 127.0.0.1:35774 remote_addr = 127.0.0.1:53885
33762025-04-30T06:29:46.208ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:62529 req_id = 2f525b9e-9d01-4890-9ee8-2507536b9b99 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
33772025-04-30T06:29:46.209ZINFOtest_image_create (dropshot): request completed latency_us = 1305 local_addr = [::1]:42828 method = GET remote_addr = [::1]:62529 req_id = 2f525b9e-9d01-4890-9ee8-2507536b9b99 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
33782025-04-30T06:29:46.210ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53885 req_id = 225ae8ab-993d-4e00-8651-f128fc2f84f6 uri = /metrics/producers
33792025-04-30T06:29:46.211ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f525b9e-9d01-4890-9ee8-2507536b9b99", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
33802025-04-30T06:29:46.213ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
33812025-04-30T06:29:46.213ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
33822025-04-30T06:29:46.213ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
33832025-04-30T06:29:46.215ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
33842025-04-30T06:29:46.216ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
33852025-04-30T06:29:46.216ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
33862025-04-30T06:29:46.216ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33872025-04-30T06:29:46.218ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33882025-04-30T06:29:46.219ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53885 req_id = 225ae8ab-993d-4e00-8651-f128fc2f84f6 resource = Database uri = /metrics/producers
33892025-04-30T06:29:46.219ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53885 req_id = 225ae8ab-993d-4e00-8651-f128fc2f84f6 roles = RoleSet { roles: {} } uri = /metrics/producers
33902025-04-30T06:29:46.219ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53885 req_id = 225ae8ab-993d-4e00-8651-f128fc2f84f6 resource = Database result = Ok(()) uri = /metrics/producers
33912025-04-30T06:29:46.220ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33922025-04-30T06:29:46.229ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
33932025-04-30T06:29:46.229ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
33942025-04-30T06:29:46.229ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
33952025-04-30T06:29:46.229ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
33962025-04-30T06:29:46.232ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33972025-04-30T06:29:46.237ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
33982025-04-30T06:29:46.237ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
33992025-04-30T06:29:46.238ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34002025-04-30T06:29:46.238ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34012025-04-30T06:29:46.239ZINFOtest_image_create (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
34022025-04-30T06:29:46.239ZINFOtest_image_create (dropshot_internal): request completed latency_us = 28612 local_addr = 127.0.0.1:35774 method = POST remote_addr = 127.0.0.1:53885 req_id = 225ae8ab-993d-4e00-8651-f128fc2f84f6 response_code = 201 uri = /metrics/producers
34032025-04-30T06:29:46.241ZDEBGtest_image_create (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "225ae8ab-993d-4e00-8651-f128fc2f84f6", "content-length": "41", "date": "Wed, 30 Apr 2025 06:29:45 GMT"} })
34042025-04-30T06:29:46.244ZDEBGtest_image_create (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
34052025-04-30T06:29:46.244ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
34062025-04-30T06:29:46.244ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
34072025-04-30T06:29:46.244ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
34082025-04-30T06:29:46.327ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
34092025-04-30T06:29:46.376ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
34102025-04-30T06:29:46.376ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
34112025-04-30T06:29:46.376ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 679.213398ms iteration = 4 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
34122025-04-30T06:29:46.376ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 5 reason = Signaled
34132025-04-30T06:29:46.376ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
34142025-04-30T06:29:46.376ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
34152025-04-30T06:29:46.376ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
34162025-04-30T06:29:46.376ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34172025-04-30T06:29:46.377ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34182025-04-30T06:29:46.379ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
34192025-04-30T06:29:46.379ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
34202025-04-30T06:29:46.379ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
34212025-04-30T06:29:46.379ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
34222025-04-30T06:29:46.380ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
34232025-04-30T06:29:46.381ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34242025-04-30T06:29:46.384ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
34252025-04-30T06:29:46.384ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
34262025-04-30T06:29:46.384ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34272025-04-30T06:29:46.385ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34282025-04-30T06:29:46.387ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34292025-04-30T06:29:46.392ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
34302025-04-30T06:29:46.392ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
34312025-04-30T06:29:46.392ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
34322025-04-30T06:29:46.392ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
34332025-04-30T06:29:46.395ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
34342025-04-30T06:29:46.395ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
34352025-04-30T06:29:46.396ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
34362025-04-30T06:29:46.396ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
34372025-04-30T06:29:46.397ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
34382025-04-30T06:29:46.398ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 6f ba 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 o............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:61012 req_id = a9c740cd-ef87-47c4-a109-db7ff7e84ea2
34392025-04-30T06:29:46.398ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 28602,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61012 req_id = a9c740cd-ef87-47c4-a109-db7ff7e84ea2
34402025-04-30T06:29:46.398ZDEBGtest_image_create (store): query key key = _mgs._tcp
34412025-04-30T06:29:46.398ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
34422025-04-30T06:29:46.398ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:61012 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = a9c740cd-ef87-47c4-a109-db7ff7e84ea2
34432025-04-30T06:29:46.399ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3451, tv_nsec: 198112000 } })
34442025-04-30T06:29:46.399ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
34452025-04-30T06:29:46.399ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: f8 13 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:55738 req_id = 56f8fce8-602c-452e-9438-d4a2f9973b7a
34462025-04-30T06:29:46.399ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63507,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55738 req_id = 56f8fce8-602c-452e-9438-d4a2f9973b7a
34472025-04-30T06:29:46.399ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
34482025-04-30T06:29:46.399ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:55738 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 56f8fce8-602c-452e-9438-d4a2f9973b7a
34492025-04-30T06:29:46.439ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
34502025-04-30T06:29:46.440ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 5d 12 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ]............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:61476 req_id = dc785488-baf2-463f-ad50-1339a5788508
34512025-04-30T06:29:46.440ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 23826,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61476 req_id = dc785488-baf2-463f-ad50-1339a5788508
34522025-04-30T06:29:46.441ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
34532025-04-30T06:29:46.441ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23826, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:61476 req_id = dc785488-baf2-463f-ad50-1339a5788508
34542025-04-30T06:29:46.442ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
34552025-04-30T06:29:46.442ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
34562025-04-30T06:29:46.442ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
34572025-04-30T06:29:46.444ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "96b716c5-f23d-4321-b8b0-77a1d0cd7c47", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34582025-04-30T06:29:46.445ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
34592025-04-30T06:29:46.446ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0c6ca3d-ce1b-45a3-8206-9fc6e0eb2a35", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34602025-04-30T06:29:46.446ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
34612025-04-30T06:29:46.449ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "99534db2-7ef3-4bf4-9f45-b13e72744d13", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34622025-04-30T06:29:46.449ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
34632025-04-30T06:29:46.451ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "722f1940-d326-42e6-8040-4850fedc1063", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34642025-04-30T06:29:46.452ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
34652025-04-30T06:29:46.454ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7330928-24b3-4123-bc97-843a532ee638", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34662025-04-30T06:29:46.454ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
34672025-04-30T06:29:46.457ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ecafdac-c5ab-4bf4-9001-250b9a458cdd", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34682025-04-30T06:29:46.457ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
34692025-04-30T06:29:46.462ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "611b8b43-13d7-4d07-9fe9-454401782b00", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34702025-04-30T06:29:46.462ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
34712025-04-30T06:29:46.466ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "08644f00-307b-4bbf-9283-474f26434299", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34722025-04-30T06:29:46.466ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
34732025-04-30T06:29:46.471ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "913d2f86-e268-48a7-9956-21227e83eaab", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34742025-04-30T06:29:46.472ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
34752025-04-30T06:29:46.474ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1ef7ceb-ae3f-42ed-b404-860c8f248019", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34762025-04-30T06:29:46.474ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
34772025-04-30T06:29:46.476ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c2b73c0-1f32-47f6-a163-139b8734da60", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34782025-04-30T06:29:46.476ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
34792025-04-30T06:29:46.479ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c9cd370-9c3f-4ae2-8228-5266289ee834", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34802025-04-30T06:29:46.479ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
34812025-04-30T06:29:46.482ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
34822025-04-30T06:29:46.486ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f54addd9-fa2c-416a-8f5b-19823bbe6f21", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34832025-04-30T06:29:46.487ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
34842025-04-30T06:29:46.514ZTRACtest_image_create (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
34852025-04-30T06:29:46.514ZTRACtest_image_create (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
34862025-04-30T06:29:46.530ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "72ffa2d3-b1ef-453a-8b32-4f7b16393cc2", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34872025-04-30T06:29:46.530ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
34882025-04-30T06:29:46.533ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "007b8933-c677-4628-8e7b-2fac12cf5aa3", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34892025-04-30T06:29:46.533ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
34902025-04-30T06:29:46.533ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
34912025-04-30T06:29:46.533ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
34922025-04-30T06:29:46.533ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
34932025-04-30T06:29:46.533ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
34942025-04-30T06:29:46.534ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
34952025-04-30T06:29:46.544ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "af46be47-cd17-4eb9-be56-1ec229a9d92b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
34962025-04-30T06:29:46.544ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
34972025-04-30T06:29:46.545ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34982025-04-30T06:29:46.563ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
34992025-04-30T06:29:46.563ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
35002025-04-30T06:29:46.563ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
35012025-04-30T06:29:46.564ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
35022025-04-30T06:29:46.566ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
35032025-04-30T06:29:46.566ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
35042025-04-30T06:29:46.579ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
35052025-04-30T06:29:46.581ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eadb75d-941e-4ddd-add6-4290cff846a1", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35062025-04-30T06:29:46.581ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
35072025-04-30T06:29:46.597ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "05403e01-b3fd-4b67-b4d1-fe6505744234", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35082025-04-30T06:29:46.597ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
35092025-04-30T06:29:46.603ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cb8de60-3972-4e19-8a74-e63410255a5c", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35102025-04-30T06:29:46.603ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
35112025-04-30T06:29:46.605ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "47292f3d-655f-4963-9884-09f38ee89fa0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35122025-04-30T06:29:46.605ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
35132025-04-30T06:29:46.609ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e4ef925-1d9a-44ad-99ab-d24340601161", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35142025-04-30T06:29:46.609ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
35152025-04-30T06:29:46.614ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b9a5f39-fe1f-4cf3-84d7-034c10bbc0ca", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35162025-04-30T06:29:46.615ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
35172025-04-30T06:29:46.628ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fe00fea-9ad8-4be0-b927-a8e74961d5ec", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35182025-04-30T06:29:46.630ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
35192025-04-30T06:29:46.631ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecb0f724-badb-4f2f-b570-a9dda42ebd97", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35202025-04-30T06:29:46.632ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
35212025-04-30T06:29:46.648ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
35222025-04-30T06:29:46.651ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9e62036-fd3e-43e8-b200-c1605a09b326", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35232025-04-30T06:29:46.652ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
35242025-04-30T06:29:46.655ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5adfa168-6cf7-4a9b-a70d-2eb0dc674e99", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35252025-04-30T06:29:46.655ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
35262025-04-30T06:29:46.659ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b35743c2-9bec-4586-91e8-496481f78422", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35272025-04-30T06:29:46.659ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
35282025-04-30T06:29:46.661ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "25c746e4-86e0-45f9-998b-d77a9d0cf82a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35292025-04-30T06:29:46.661ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
35302025-04-30T06:29:46.712ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
35312025-04-30T06:29:46.712ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35322025-04-30T06:29:46.712ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
35332025-04-30T06:29:46.712ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
35342025-04-30T06:29:46.732ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
35352025-04-30T06:29:46.755ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fd9d059-b1e1-4c32-90c0-516eee62b655", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35362025-04-30T06:29:46.756ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
35372025-04-30T06:29:46.757ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35382025-04-30T06:29:46.763ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
35392025-04-30T06:29:46.763ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
35402025-04-30T06:29:46.763ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
35412025-04-30T06:29:46.763ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
35422025-04-30T06:29:46.766ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
35432025-04-30T06:29:46.766ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
35442025-04-30T06:29:46.767ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
35452025-04-30T06:29:46.768ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9d110e4-7158-4a35-b565-12ec656d47ea", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35462025-04-30T06:29:46.769ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
35472025-04-30T06:29:46.770ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "78624fdb-d8a0-41ae-933c-09ea2eb566fc", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35482025-04-30T06:29:46.771ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
35492025-04-30T06:29:46.773ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dcd623d-5c68-4427-8ddc-a3b456e25e3a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35502025-04-30T06:29:46.773ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
35512025-04-30T06:29:46.775ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "16aae259-20a9-4b60-a85b-65ed8aa4c8ac", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35522025-04-30T06:29:46.775ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
35532025-04-30T06:29:46.777ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cda2cbe-f9c0-44ae-a35e-6c47be137c94", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35542025-04-30T06:29:46.777ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
35552025-04-30T06:29:46.779ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f982d3c6-d85d-4074-abea-fae8e7506da8", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35562025-04-30T06:29:46.780ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
35572025-04-30T06:29:46.810ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "93416390-0427-458a-ac6d-88047828ba82", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35582025-04-30T06:29:46.810ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
35592025-04-30T06:29:46.816ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad9efe84-5d8e-41cc-bdda-2a16729147a4", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35602025-04-30T06:29:46.816ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
35612025-04-30T06:29:46.824ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
35622025-04-30T06:29:46.835ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "70e703a7-70e5-4cdf-a8b1-a5ca124732c7", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35632025-04-30T06:29:46.835ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
35642025-04-30T06:29:46.837ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "46729337-8431-4396-8c02-80a15fe6d4eb", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35652025-04-30T06:29:46.837ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
35662025-04-30T06:29:46.840ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "24628f71-b93a-4c2d-8840-c7b8d58d6993", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35672025-04-30T06:29:46.840ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
35682025-04-30T06:29:46.847ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab74e01d-f074-4077-9a64-353da90a250d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35692025-04-30T06:29:46.853ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
35702025-04-30T06:29:46.857ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a959a6a5-ffd3-4ade-b60b-3fc1e86595f0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35712025-04-30T06:29:46.858ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
35722025-04-30T06:29:46.859ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b10187c-a543-4b60-a7db-a184c73c7ed6", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35732025-04-30T06:29:46.860ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
35742025-04-30T06:29:46.861ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "70c5ef27-0f6c-40a8-b042-4e3c6ddd0701", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35752025-04-30T06:29:46.861ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
35762025-04-30T06:29:46.862ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ec415bb-5978-48cb-8276-4cf7bf24432e", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
35772025-04-30T06:29:46.862ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
35782025-04-30T06:29:46.862ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35792025-04-30T06:29:46.862ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
35802025-04-30T06:29:46.862ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
35812025-04-30T06:29:46.863ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
35822025-04-30T06:29:46.867ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35832025-04-30T06:29:46.879ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
35842025-04-30T06:29:46.879ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
35852025-04-30T06:29:46.879ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35862025-04-30T06:29:46.879ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
35872025-04-30T06:29:46.879ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
35882025-04-30T06:29:46.879ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
35892025-04-30T06:29:46.880ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
35902025-04-30T06:29:46.880ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35912025-04-30T06:29:46.880ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
35922025-04-30T06:29:46.880ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
35932025-04-30T06:29:46.880ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
35942025-04-30T06:29:46.882ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35952025-04-30T06:29:46.889ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
35962025-04-30T06:29:46.889ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
35972025-04-30T06:29:46.889ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
35982025-04-30T06:29:46.889ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
35992025-04-30T06:29:46.893ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002025-04-30T06:29:46.903ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
36012025-04-30T06:29:46.903ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
36022025-04-30T06:29:46.903ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
36032025-04-30T06:29:46.903ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
36042025-04-30T06:29:46.907ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
36052025-04-30T06:29:46.908ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
36062025-04-30T06:29:46.908ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
36072025-04-30T06:29:46.962ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
36082025-04-30T06:29:46.962ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
36092025-04-30T06:29:46.963ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:38031 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
36102025-04-30T06:29:46.963ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:38031 req_id = be2da50c-bf92-4751-91a1-bd9fb033970b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
36112025-04-30T06:29:46.964ZINFOtest_image_create (dropshot): request completed latency_us = 780 local_addr = [::1]:42828 method = GET remote_addr = [::1]:38031 req_id = be2da50c-bf92-4751-91a1-bd9fb033970b response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
36122025-04-30T06:29:46.965ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "be2da50c-bf92-4751-91a1-bd9fb033970b", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36132025-04-30T06:29:46.967ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36142025-04-30T06:29:46.967ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36152025-04-30T06:29:46.967ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
36162025-04-30T06:29:46.969ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
36172025-04-30T06:29:46.970ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
36182025-04-30T06:29:46.970ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
36192025-04-30T06:29:46.970ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36202025-04-30T06:29:46.971ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36212025-04-30T06:29:46.977ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222025-04-30T06:29:46.982ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
36232025-04-30T06:29:46.982ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
36242025-04-30T06:29:46.982ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36252025-04-30T06:29:46.983ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36262025-04-30T06:29:47.042ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
36272025-04-30T06:29:47.056ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
36282025-04-30T06:29:47.056ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
36292025-04-30T06:29:47.056ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 680.134353ms iteration = 5 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
36302025-04-30T06:29:47.057ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 6 reason = Signaled
36312025-04-30T06:29:47.057ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
36322025-04-30T06:29:47.057ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
36332025-04-30T06:29:47.057ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
36342025-04-30T06:29:47.057ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36352025-04-30T06:29:47.057ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36362025-04-30T06:29:47.060ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36372025-04-30T06:29:47.064ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
36382025-04-30T06:29:47.064ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
36392025-04-30T06:29:47.064ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36402025-04-30T06:29:47.064ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36412025-04-30T06:29:47.070ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
36422025-04-30T06:29:47.070ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
36432025-04-30T06:29:47.071ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 0a 53 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .S..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:65293 req_id = 53a6c018-6236-4d17-9b11-445ab73b84cb
36442025-04-30T06:29:47.071ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2643,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65293 req_id = 53a6c018-6236-4d17-9b11-445ab73b84cb
36452025-04-30T06:29:47.071ZDEBGtest_image_create (store): query key key = _mgs._tcp
36462025-04-30T06:29:47.071ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
36472025-04-30T06:29:47.071ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:65293 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 53a6c018-6236-4d17-9b11-445ab73b84cb
36482025-04-30T06:29:47.072ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3451, tv_nsec: 871197359 } })
36492025-04-30T06:29:47.072ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
36502025-04-30T06:29:47.072ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 53 03 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e S...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:58014 req_id = 3bb52417-2dbb-4b17-9479-cc5cc6b550b2
36512025-04-30T06:29:47.072ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 21251,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58014 req_id = 3bb52417-2dbb-4b17-9479-cc5cc6b550b2
36522025-04-30T06:29:47.073ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
36532025-04-30T06:29:47.073ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:58014 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 3bb52417-2dbb-4b17-9479-cc5cc6b550b2
36542025-04-30T06:29:47.173ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
36552025-04-30T06:29:47.188ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
36562025-04-30T06:29:47.188ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
36572025-04-30T06:29:47.188ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
36582025-04-30T06:29:47.188ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
36592025-04-30T06:29:47.189ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
36602025-04-30T06:29:47.190ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 17 71 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .q..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:56386 req_id = 695dc918-415f-4f35-8064-3cda04ddecb2
36612025-04-30T06:29:47.190ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 6001,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56386 req_id = 695dc918-415f-4f35-8064-3cda04ddecb2
36622025-04-30T06:29:47.190ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
36632025-04-30T06:29:47.195ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6001, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:56386 req_id = 695dc918-415f-4f35-8064-3cda04ddecb2
36642025-04-30T06:29:47.197ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
36652025-04-30T06:29:47.197ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
36662025-04-30T06:29:47.197ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
36672025-04-30T06:29:47.198ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36682025-04-30T06:29:47.205ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
36692025-04-30T06:29:47.205ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
36702025-04-30T06:29:47.205ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
36712025-04-30T06:29:47.205ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
36722025-04-30T06:29:47.207ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0b5a86e-ffa3-4f17-8d5e-a757197c3c75", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36732025-04-30T06:29:47.208ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
36742025-04-30T06:29:47.208ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
36752025-04-30T06:29:47.208ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
36762025-04-30T06:29:47.208ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
36772025-04-30T06:29:47.210ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "12b674d1-a52b-450b-9970-244b602726ef", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36782025-04-30T06:29:47.210ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
36792025-04-30T06:29:47.213ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8543fcb4-aeb6-458e-b16d-fac0d3874292", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36802025-04-30T06:29:47.213ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
36812025-04-30T06:29:47.215ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "791e654e-e55a-439d-925c-9fe88377c163", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36822025-04-30T06:29:47.215ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
36832025-04-30T06:29:47.217ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfa1ec50-3f1d-4268-bbb5-5722b56f7fcd", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36842025-04-30T06:29:47.217ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
36852025-04-30T06:29:47.227ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8eb17dea-b11d-430b-9e4e-477736cd273a", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36862025-04-30T06:29:47.227ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
36872025-04-30T06:29:47.254ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "731cc040-a8a8-46c8-9741-70f4f65dfd88", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36882025-04-30T06:29:47.255ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
36892025-04-30T06:29:47.259ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "905132e7-73e3-4723-b34d-890923da4c31", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36902025-04-30T06:29:47.260ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
36912025-04-30T06:29:47.261ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3b76b35-f468-4a7b-956e-48e4c296fe43", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36922025-04-30T06:29:47.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
36932025-04-30T06:29:47.263ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "61b3deaa-547b-4bcf-af92-fec792d951be", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36942025-04-30T06:29:47.263ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
36952025-04-30T06:29:47.264ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d50a8ae-8974-4df3-a6bc-bb5f11bd00e1", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36962025-04-30T06:29:47.264ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
36972025-04-30T06:29:47.285ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa3f469d-a316-4140-b266-5735232651a6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
36982025-04-30T06:29:47.286ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
36992025-04-30T06:29:47.289ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1feb1839-1629-409f-9a79-d5e214cdf794", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37002025-04-30T06:29:47.289ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
37012025-04-30T06:29:47.290ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5075b06f-1894-462d-bbbd-cda35e40a57d", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37022025-04-30T06:29:47.290ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
37032025-04-30T06:29:47.292ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0ba0e30-c786-409d-b1db-ca937a91fc83", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37042025-04-30T06:29:47.292ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
37052025-04-30T06:29:47.303ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
37062025-04-30T06:29:47.305ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "25910633-712d-4919-94ea-708a27e1e1ff", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37072025-04-30T06:29:47.305ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
37082025-04-30T06:29:47.310ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
37092025-04-30T06:29:47.310ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
37102025-04-30T06:29:47.311ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 7f7789a9-ee92-41ac-b7f2-8a7ac3776b50 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
37112025-04-30T06:29:47.311ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 7f7789a9-ee92-41ac-b7f2-8a7ac3776b50 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
37122025-04-30T06:29:47.312ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 7f7789a9-ee92-41ac-b7f2-8a7ac3776b50 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
37132025-04-30T06:29:47.313ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 7f7789a9-ee92-41ac-b7f2-8a7ac3776b50 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
37142025-04-30T06:29:47.317ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b4c9ee3-0f1f-4db3-a1d8-5db0ffb698d8", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37152025-04-30T06:29:47.317ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
37162025-04-30T06:29:47.318ZINFOtest_image_create (dropshot_internal): request completed latency_us = 7309 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 7f7789a9-ee92-41ac-b7f2-8a7ac3776b50 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
37172025-04-30T06:29:47.319ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f7789a9-ee92-41ac-b7f2-8a7ac3776b50", "content-length": "405", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37182025-04-30T06:29:47.322ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
37192025-04-30T06:29:47.323ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 2576d80b-c5d5-402c-9618-35d1246312e5 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
37202025-04-30T06:29:47.323ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 2576d80b-c5d5-402c-9618-35d1246312e5 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
37212025-04-30T06:29:47.323ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 2576d80b-c5d5-402c-9618-35d1246312e5 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
37222025-04-30T06:29:47.324ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 2576d80b-c5d5-402c-9618-35d1246312e5 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
37232025-04-30T06:29:47.330ZINFOtest_image_create (dropshot_internal): request completed latency_us = 7258 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 2576d80b-c5d5-402c-9618-35d1246312e5 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
37242025-04-30T06:29:47.340ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "2576d80b-c5d5-402c-9618-35d1246312e5", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37252025-04-30T06:29:47.340ZDEBGtest_image_create (oximeter-agent): registered new metric producer address = 127.0.0.1:36387 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
37262025-04-30T06:29:47.341ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4370a645-a204-4888-b83f-fd0d9b7a2cf4", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:46 GMT"} })
37272025-04-30T06:29:47.341ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
37282025-04-30T06:29:47.414ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
37292025-04-30T06:29:47.415ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
37302025-04-30T06:29:47.415ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37312025-04-30T06:29:47.415ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
37322025-04-30T06:29:47.415ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
37332025-04-30T06:29:47.416ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
37342025-04-30T06:29:47.417ZDEBGtest_image_create (oximeter-agent): registered new metric producer address = [::1]:39018 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
37352025-04-30T06:29:47.503ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
37362025-04-30T06:29:47.506ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
37372025-04-30T06:29:47.510ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382025-04-30T06:29:47.515ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
37392025-04-30T06:29:47.546ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
37402025-04-30T06:29:47.546ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
37412025-04-30T06:29:47.547ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
37422025-04-30T06:29:47.551ZTRACtest_image_create (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
37432025-04-30T06:29:47.551ZTRACtest_image_create (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
37442025-04-30T06:29:47.557ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
37452025-04-30T06:29:47.557ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
37462025-04-30T06:29:47.558ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
37472025-04-30T06:29:47.609ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e2bb192-ba14-4a5b-a366-10634a0c5a49", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37482025-04-30T06:29:47.609ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
37492025-04-30T06:29:47.619ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "737f13f5-fa46-410a-a04b-11aef8c64d91", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37502025-04-30T06:29:47.619ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
37512025-04-30T06:29:47.656ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "55927bbe-40f1-4ba2-a628-9f26aae150b3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37522025-04-30T06:29:47.657ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
37532025-04-30T06:29:47.663ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9dfdcae-a3d6-435f-a355-42cc67ae8ac2", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37542025-04-30T06:29:47.663ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
37552025-04-30T06:29:47.665ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f8fa877-9408-4850-b249-65ecdeb24086", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37562025-04-30T06:29:47.666ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
37572025-04-30T06:29:47.669ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e91d29f4-396f-445d-a78e-a75bfd14e119", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37582025-04-30T06:29:47.669ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
37592025-04-30T06:29:47.673ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
37602025-04-30T06:29:47.676ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b75c5cd-fe72-4c82-a554-db8151f1c989", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37612025-04-30T06:29:47.676ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
37622025-04-30T06:29:47.680ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "150fb5b8-f641-4770-9e5d-a54ab2b64e37", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37632025-04-30T06:29:47.681ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
37642025-04-30T06:29:47.686ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "28fb4b31-56f9-4c3f-9db9-a5d90c7a7db8", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37652025-04-30T06:29:47.686ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
37662025-04-30T06:29:47.690ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f423e277-c3e5-469e-9343-b3763ebc9799", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37672025-04-30T06:29:47.690ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
37682025-04-30T06:29:47.693ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5b29ef5-c4a0-4581-bffe-c3a29241ecd0", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37692025-04-30T06:29:47.694ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
37702025-04-30T06:29:47.713ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "754efc8e-6c1c-4325-b025-0ea5c6ebfb48", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37712025-04-30T06:29:47.713ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
37722025-04-30T06:29:47.715ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1e55fd9-5141-4044-a347-15b5b2803713", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37732025-04-30T06:29:47.723ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
37742025-04-30T06:29:47.737ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
37752025-04-30T06:29:47.737ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37762025-04-30T06:29:47.737ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
37772025-04-30T06:29:47.737ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
37782025-04-30T06:29:47.738ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
37792025-04-30T06:29:47.740ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e35bdbe-3e3b-46de-94e3-7343ebce769f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37802025-04-30T06:29:47.740ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
37812025-04-30T06:29:47.741ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37822025-04-30T06:29:47.748ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
37832025-04-30T06:29:47.748ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
37842025-04-30T06:29:47.748ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
37852025-04-30T06:29:47.748ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
37862025-04-30T06:29:47.750ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9752fa43-598e-4e57-8379-37ee6d48fb52", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37872025-04-30T06:29:47.750ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
37882025-04-30T06:29:47.751ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9ae9ec9-30db-4c41-a474-be33fc66d4d6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37892025-04-30T06:29:47.751ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
37902025-04-30T06:29:47.751ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
37912025-04-30T06:29:47.752ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
37922025-04-30T06:29:47.753ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
37932025-04-30T06:29:47.754ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97b8a8fd-04a8-4843-9f10-7defa2408c08", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37942025-04-30T06:29:47.754ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
37952025-04-30T06:29:47.767ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2a17854-966c-4895-bc4e-04b56f9a2d1d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37962025-04-30T06:29:47.767ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
37972025-04-30T06:29:47.772ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcec907c-3731-469d-bce8-7ab98bf0b1f9", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
37982025-04-30T06:29:47.773ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
37992025-04-30T06:29:47.799ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64bb129b-3c90-4d80-941a-2ef525ef1602", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38002025-04-30T06:29:47.799ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
38012025-04-30T06:29:47.806ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "863ed56d-02b4-4092-b42b-6fc00266103a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38022025-04-30T06:29:47.806ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
38032025-04-30T06:29:47.808ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "29eeb93f-c747-4731-baf9-5567bbb6ab25", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38042025-04-30T06:29:47.808ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
38052025-04-30T06:29:47.811ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
38062025-04-30T06:29:47.811ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "670ab32b-e685-4a0c-a834-c0a8f18c2bd8", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38072025-04-30T06:29:47.811ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
38082025-04-30T06:29:47.813ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9faf4414-e5cc-43ee-9775-61f9abd7781a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38092025-04-30T06:29:47.813ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
38102025-04-30T06:29:47.814ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "57aef492-ec7d-4ba2-a45e-c647b6020cae", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38112025-04-30T06:29:47.814ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
38122025-04-30T06:29:47.815ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a11384c-929b-4526-8ab5-7279f2717e70", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38132025-04-30T06:29:47.815ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
38142025-04-30T06:29:47.816ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "32c481dd-3475-4133-a8ba-c36e22a45f68", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38152025-04-30T06:29:47.816ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
38162025-04-30T06:29:47.816ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38172025-04-30T06:29:47.816ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
38182025-04-30T06:29:47.816ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38192025-04-30T06:29:47.817ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38202025-04-30T06:29:47.821ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38212025-04-30T06:29:47.825ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
38222025-04-30T06:29:47.825ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
38232025-04-30T06:29:47.825ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38242025-04-30T06:29:47.825ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
38252025-04-30T06:29:47.825ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38262025-04-30T06:29:47.826ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38272025-04-30T06:29:47.828ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38282025-04-30T06:29:47.831ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
38292025-04-30T06:29:47.831ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
38302025-04-30T06:29:47.831ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38312025-04-30T06:29:47.832ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38322025-04-30T06:29:47.922ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
38332025-04-30T06:29:47.922ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
38342025-04-30T06:29:47.922ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
38352025-04-30T06:29:47.922ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38362025-04-30T06:29:47.923ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
38372025-04-30T06:29:47.923ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
38382025-04-30T06:29:47.927ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
38392025-04-30T06:29:47.928ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:65384 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
38402025-04-30T06:29:47.946ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:65384 req_id = dfd7a9d7-a065-481d-996f-d8496746148a sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
38412025-04-30T06:29:47.947ZINFOtest_image_create (dropshot): request completed latency_us = 1493 local_addr = [::1]:42828 method = GET remote_addr = [::1]:65384 req_id = dfd7a9d7-a065-481d-996f-d8496746148a response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
38422025-04-30T06:29:47.948ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38432025-04-30T06:29:47.953ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
38442025-04-30T06:29:47.954ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
38452025-04-30T06:29:47.954ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
38462025-04-30T06:29:47.954ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
38472025-04-30T06:29:47.954ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfd7a9d7-a065-481d-996f-d8496746148a", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
38482025-04-30T06:29:47.957ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
38492025-04-30T06:29:47.957ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
38502025-04-30T06:29:47.957ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
38512025-04-30T06:29:47.960ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
38522025-04-30T06:29:47.960ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38532025-04-30T06:29:47.960ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
38542025-04-30T06:29:47.960ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38552025-04-30T06:29:47.960ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38562025-04-30T06:29:47.965ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
38572025-04-30T06:29:47.969ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
38582025-04-30T06:29:47.970ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
38592025-04-30T06:29:47.979ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38602025-04-30T06:29:47.983ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
38612025-04-30T06:29:47.983ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
38622025-04-30T06:29:47.983ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38632025-04-30T06:29:47.983ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38642025-04-30T06:29:48.046ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
38652025-04-30T06:29:48.046ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
38662025-04-30T06:29:48.047ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 989.834591ms iteration = 6 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
38672025-04-30T06:29:48.047ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 7 reason = Signaled
38682025-04-30T06:29:48.047ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
38692025-04-30T06:29:48.047ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38702025-04-30T06:29:48.047ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
38712025-04-30T06:29:48.047ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38722025-04-30T06:29:48.048ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38732025-04-30T06:29:48.061ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742025-04-30T06:29:48.065ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
38752025-04-30T06:29:48.065ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
38762025-04-30T06:29:48.065ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38772025-04-30T06:29:48.066ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38782025-04-30T06:29:48.070ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
38792025-04-30T06:29:48.074ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
38802025-04-30T06:29:48.074ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
38812025-04-30T06:29:48.074ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 8e c3 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:55308 req_id = 876f370c-4b0d-48fa-9fc4-ef8438a4348d
38822025-04-30T06:29:48.074ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 36547,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55308 req_id = 876f370c-4b0d-48fa-9fc4-ef8438a4348d
38832025-04-30T06:29:48.075ZDEBGtest_image_create (store): query key key = _mgs._tcp
38842025-04-30T06:29:48.075ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
38852025-04-30T06:29:48.075ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:55308 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 876f370c-4b0d-48fa-9fc4-ef8438a4348d
38862025-04-30T06:29:48.075ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3452, tv_nsec: 874652167 } })
38872025-04-30T06:29:48.075ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
38882025-04-30T06:29:48.076ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 7c 37 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e |7..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:59823 req_id = 2f32a943-f012-4274-878c-dfca4f6f31c5
38892025-04-30T06:29:48.076ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 31799,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59823 req_id = 2f32a943-f012-4274-878c-dfca4f6f31c5
38902025-04-30T06:29:48.076ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
38912025-04-30T06:29:48.076ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59823 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 2f32a943-f012-4274-878c-dfca4f6f31c5
38922025-04-30T06:29:48.140ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
38932025-04-30T06:29:48.141ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
38942025-04-30T06:29:48.141ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38952025-04-30T06:29:48.141ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
38962025-04-30T06:29:48.141ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
38972025-04-30T06:29:48.142ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
38982025-04-30T06:29:48.142ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 21 7e 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c !~..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:51776 req_id = 0558b2d1-6968-42fc-bd66-5afc6459db76
38992025-04-30T06:29:48.143ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 8574,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51776 req_id = 0558b2d1-6968-42fc-bd66-5afc6459db76
39002025-04-30T06:29:48.143ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
39012025-04-30T06:29:48.143ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8574, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:51776 req_id = 0558b2d1-6968-42fc-bd66-5afc6459db76
39022025-04-30T06:29:48.144ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
39032025-04-30T06:29:48.144ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
39042025-04-30T06:29:48.144ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
39052025-04-30T06:29:48.145ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062025-04-30T06:29:48.150ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
39072025-04-30T06:29:48.150ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
39082025-04-30T06:29:48.150ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
39092025-04-30T06:29:48.151ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
39102025-04-30T06:29:48.153ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e730598-761a-4b16-831b-9ea1b59df8bd", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39112025-04-30T06:29:48.153ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
39122025-04-30T06:29:48.154ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
39132025-04-30T06:29:48.154ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
39142025-04-30T06:29:48.154ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
39152025-04-30T06:29:48.155ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5567cfc1-2b9e-4460-b6d2-1de42e4ddbb7", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39162025-04-30T06:29:48.155ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
39172025-04-30T06:29:48.158ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "523fa5fd-d308-421e-aa15-858e19aaaa9f", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39182025-04-30T06:29:48.158ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
39192025-04-30T06:29:48.161ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed2b8aed-833a-49f8-a274-63bacc078e1f", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39202025-04-30T06:29:48.162ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
39212025-04-30T06:29:48.210ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d87dfb80-8f3a-48e4-ada6-dc636834955f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39222025-04-30T06:29:48.210ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
39232025-04-30T06:29:48.214ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8db90b96-a9bc-4473-969e-041f687a84ec", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39242025-04-30T06:29:48.215ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
39252025-04-30T06:29:48.219ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "25dfc0a2-0235-4224-936d-3baaf6b294e9", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39262025-04-30T06:29:48.219ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
39272025-04-30T06:29:48.228ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e7799bd-7c0d-491f-a506-74b204e7192d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39282025-04-30T06:29:48.228ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
39292025-04-30T06:29:48.229ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
39302025-04-30T06:29:48.231ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "45ac9d67-cb10-43d4-bd99-335297076705", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39312025-04-30T06:29:48.231ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
39322025-04-30T06:29:48.233ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe74e916-64f1-42ff-b94f-c6ce7e20f456", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39332025-04-30T06:29:48.233ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
39342025-04-30T06:29:48.235ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "083f0ef7-d91d-4fb3-a70a-645f72f58392", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39352025-04-30T06:29:48.236ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
39362025-04-30T06:29:48.237ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aa33d6f-bf1b-4882-b4c5-c2713f6d8293", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39372025-04-30T06:29:48.238ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
39382025-04-30T06:29:48.240ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bcef674-cf68-466b-b272-00fcfa600d38", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39392025-04-30T06:29:48.240ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
39402025-04-30T06:29:48.243ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "953ba043-fd4f-4f72-ae86-dff6092c2107", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39412025-04-30T06:29:48.243ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
39422025-04-30T06:29:48.247ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e461f46e-0ba4-443d-8646-e80e2416c08b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39432025-04-30T06:29:48.248ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
39442025-04-30T06:29:48.251ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7604dc21-3d8f-4d14-9b34-aad3049929a0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39452025-04-30T06:29:48.251ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
39462025-04-30T06:29:48.256ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bc68cfd-8416-4b6a-9397-8234dfd0e7fc", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39472025-04-30T06:29:48.256ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
39482025-04-30T06:29:48.258ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f11093b-7fb1-4cec-a0fd-0458c607953e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39492025-04-30T06:29:48.259ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
39502025-04-30T06:29:48.262ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a9baf3a-854f-499a-be65-4a27a4cc65e0", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39512025-04-30T06:29:48.263ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
39522025-04-30T06:29:48.264ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f72dd30-14dc-4fa1-a26c-039a2b07b3d8", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39532025-04-30T06:29:48.264ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
39542025-04-30T06:29:48.266ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8984b34-5c17-4841-b5ae-b63b8ed8d3a5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39552025-04-30T06:29:48.266ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
39562025-04-30T06:29:48.267ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa50d6ed-72bf-4349-9f0f-9924c234be61", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39572025-04-30T06:29:48.267ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
39582025-04-30T06:29:48.268ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0c92530-4952-494b-879c-bd72d8d56fec", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39592025-04-30T06:29:48.269ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
39602025-04-30T06:29:48.271ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "124e6303-284d-4c73-abb3-06fa4dd80c01", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39612025-04-30T06:29:48.272ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
39622025-04-30T06:29:48.274ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7cdb092-d96c-45e5-8086-c5c075405386", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39632025-04-30T06:29:48.275ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
39642025-04-30T06:29:48.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5b76521-0cb9-4c73-b3aa-f92b673111ed", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39652025-04-30T06:29:48.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
39662025-04-30T06:29:48.281ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
39672025-04-30T06:29:48.281ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
39682025-04-30T06:29:48.281ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
39692025-04-30T06:29:48.281ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
39702025-04-30T06:29:48.282ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
39712025-04-30T06:29:48.284ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1c501e7-5e6d-4909-86e4-f5a69b6981b1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39722025-04-30T06:29:48.284ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
39732025-04-30T06:29:48.284ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39742025-04-30T06:29:48.290ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
39752025-04-30T06:29:48.290ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
39762025-04-30T06:29:48.290ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
39772025-04-30T06:29:48.291ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
39782025-04-30T06:29:48.293ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
39792025-04-30T06:29:48.293ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
39802025-04-30T06:29:48.294ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
39812025-04-30T06:29:48.295ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "915a746c-3e47-4bb5-a57e-cc9154c1e344", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39822025-04-30T06:29:48.296ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
39832025-04-30T06:29:48.299ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d09ff86-c4f0-475d-9c53-981d80b06375", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39842025-04-30T06:29:48.299ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
39852025-04-30T06:29:48.304ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e2f39fe-0263-4123-a849-351b5e24a320", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39862025-04-30T06:29:48.305ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
39872025-04-30T06:29:48.306ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3d732da-6ce7-428b-bfc5-6aabfd540145", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39882025-04-30T06:29:48.306ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
39892025-04-30T06:29:48.324ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "503775f3-cdc2-447f-9805-8d1c6412f4b5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39902025-04-30T06:29:48.324ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
39912025-04-30T06:29:48.335ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6726b9a-359a-4f11-8444-a83c42a30f64", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39922025-04-30T06:29:48.336ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
39932025-04-30T06:29:48.339ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b0cfc69-6a0d-49ca-9d02-2504be2f5b80", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39942025-04-30T06:29:48.340ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
39952025-04-30T06:29:48.343ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d42b600b-9e2f-48fd-a3fb-c357f31c0490", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39962025-04-30T06:29:48.343ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
39972025-04-30T06:29:48.350ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
39982025-04-30T06:29:48.351ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ed91a6f-a0f5-4ac7-9544-978e36026f88", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
39992025-04-30T06:29:48.352ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
40002025-04-30T06:29:48.357ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1af80e13-90c4-47bb-9754-bb28b2305c47", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40012025-04-30T06:29:48.357ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
40022025-04-30T06:29:48.361ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73eea26e-6a82-4167-aed9-75f22a8fa7d2", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40032025-04-30T06:29:48.361ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
40042025-04-30T06:29:48.364ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5df53c7d-a296-42eb-bcdf-9cc5e4e7f7bc", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40052025-04-30T06:29:48.364ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
40062025-04-30T06:29:48.368ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c7fdc4c-8e44-4802-9e79-289e71a5a5ca", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40072025-04-30T06:29:48.368ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
40082025-04-30T06:29:48.371ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "94c0dd98-fd4e-45e8-bbd0-08f9c9c3a5a5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40092025-04-30T06:29:48.371ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
40102025-04-30T06:29:48.375ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c8d2546-4646-4c09-9de9-ab1510f381cc", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40112025-04-30T06:29:48.381ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
40122025-04-30T06:29:48.384ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a651218a-014e-4b09-992e-a0567371a9ec", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40132025-04-30T06:29:48.385ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
40142025-04-30T06:29:48.385ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "18185524-f34a-4357-9526-4b52918793f2", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40152025-04-30T06:29:48.385ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
40162025-04-30T06:29:48.386ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a11870d-3825-4250-89f4-5a1545968094", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:47 GMT"} })
40172025-04-30T06:29:48.387ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
40182025-04-30T06:29:48.387ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40192025-04-30T06:29:48.387ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
40202025-04-30T06:29:48.387ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40212025-04-30T06:29:48.387ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40222025-04-30T06:29:48.403ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
40232025-04-30T06:29:48.403ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40242025-04-30T06:29:48.403ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
40252025-04-30T06:29:48.403ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
40262025-04-30T06:29:48.404ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
40272025-04-30T06:29:48.405ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40282025-04-30T06:29:48.409ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
40292025-04-30T06:29:48.409ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
40302025-04-30T06:29:48.409ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40312025-04-30T06:29:48.410ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
40322025-04-30T06:29:48.410ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40332025-04-30T06:29:48.410ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40342025-04-30T06:29:48.410ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40352025-04-30T06:29:48.416ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
40362025-04-30T06:29:48.416ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
40372025-04-30T06:29:48.416ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
40382025-04-30T06:29:48.416ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
40392025-04-30T06:29:48.430ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
40402025-04-30T06:29:48.430ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
40412025-04-30T06:29:48.431ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40422025-04-30T06:29:48.437ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
40432025-04-30T06:29:48.438ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
40442025-04-30T06:29:48.438ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40452025-04-30T06:29:48.439ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40462025-04-30T06:29:48.611ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
40472025-04-30T06:29:48.611ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
40482025-04-30T06:29:48.611ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
40492025-04-30T06:29:48.612ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
40502025-04-30T06:29:48.613ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
40512025-04-30T06:29:48.613ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:43783 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
40522025-04-30T06:29:48.613ZTRACtest_image_create (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
40532025-04-30T06:29:48.613ZTRACtest_image_create (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
40542025-04-30T06:29:48.614ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
40552025-04-30T06:29:48.615ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
40562025-04-30T06:29:48.615ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
40572025-04-30T06:29:48.615ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
40582025-04-30T06:29:48.616ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:43783 req_id = 1f262340-f6c5-4498-bc41-8db321d4e4e9 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
40592025-04-30T06:29:48.617ZINFOtest_image_create (dropshot): request completed latency_us = 499 local_addr = [::1]:42828 method = GET remote_addr = [::1]:43783 req_id = 1f262340-f6c5-4498-bc41-8db321d4e4e9 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
40602025-04-30T06:29:48.618ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f262340-f6c5-4498-bc41-8db321d4e4e9", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
40612025-04-30T06:29:48.620ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
40622025-04-30T06:29:48.620ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
40632025-04-30T06:29:48.620ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
40642025-04-30T06:29:48.621ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
40652025-04-30T06:29:48.621ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40662025-04-30T06:29:48.621ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
40672025-04-30T06:29:48.621ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40682025-04-30T06:29:48.627ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40692025-04-30T06:29:48.631ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702025-04-30T06:29:48.635ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
40712025-04-30T06:29:48.636ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
40722025-04-30T06:29:48.636ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40732025-04-30T06:29:48.636ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40742025-04-30T06:29:48.704ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
40752025-04-30T06:29:48.705ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
40762025-04-30T06:29:48.705ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
40772025-04-30T06:29:48.705ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 658.42548ms iteration = 7 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
40782025-04-30T06:29:48.706ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 8 reason = Signaled
40792025-04-30T06:29:48.706ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
40802025-04-30T06:29:48.706ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40812025-04-30T06:29:48.706ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
40822025-04-30T06:29:48.706ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40832025-04-30T06:29:48.707ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40842025-04-30T06:29:48.709ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852025-04-30T06:29:48.713ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
40862025-04-30T06:29:48.713ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
40872025-04-30T06:29:48.713ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40882025-04-30T06:29:48.713ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40892025-04-30T06:29:48.716ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
40902025-04-30T06:29:48.716ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
40912025-04-30T06:29:48.717ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: b0 d8 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:58832 req_id = 2354d5bc-f9e2-48ce-8dd3-4a1a54a84a84
40922025-04-30T06:29:48.717ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45272,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58832 req_id = 2354d5bc-f9e2-48ce-8dd3-4a1a54a84a84
40932025-04-30T06:29:48.717ZDEBGtest_image_create (store): query key key = _mgs._tcp
40942025-04-30T06:29:48.717ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
40952025-04-30T06:29:48.717ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:58832 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 2354d5bc-f9e2-48ce-8dd3-4a1a54a84a84
40962025-04-30T06:29:48.718ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3453, tv_nsec: 516916577 } })
40972025-04-30T06:29:48.718ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
40982025-04-30T06:29:48.718ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: d3 c8 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:54573 req_id = 7638d545-e56b-4249-95c9-65ea668b6001
40992025-04-30T06:29:48.718ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 54216,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54573 req_id = 7638d545-e56b-4249-95c9-65ea668b6001
41002025-04-30T06:29:48.718ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
41012025-04-30T06:29:48.718ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:54573 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 7638d545-e56b-4249-95c9-65ea668b6001
41022025-04-30T06:29:48.792ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
41032025-04-30T06:29:48.793ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
41042025-04-30T06:29:48.793ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41052025-04-30T06:29:48.793ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
41062025-04-30T06:29:48.793ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
41072025-04-30T06:29:48.794ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
41082025-04-30T06:29:48.799ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 78 28 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c x(..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:49950 req_id = c8357bfc-c204-4e05-a978-00d0f7900652
41092025-04-30T06:29:48.800ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 30760,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49950 req_id = c8357bfc-c204-4e05-a978-00d0f7900652
41102025-04-30T06:29:48.800ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
41112025-04-30T06:29:48.800ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30760, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:49950 req_id = c8357bfc-c204-4e05-a978-00d0f7900652
41122025-04-30T06:29:48.801ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
41132025-04-30T06:29:48.801ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
41142025-04-30T06:29:48.801ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
41152025-04-30T06:29:48.802ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41162025-04-30T06:29:48.811ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
41172025-04-30T06:29:48.811ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
41182025-04-30T06:29:48.811ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
41192025-04-30T06:29:48.811ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
41202025-04-30T06:29:48.813ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b1b592c-4185-4f90-95cc-57d4466fabdd", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41212025-04-30T06:29:48.813ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
41222025-04-30T06:29:48.814ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
41232025-04-30T06:29:48.814ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
41242025-04-30T06:29:48.815ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
41252025-04-30T06:29:48.815ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec885032-e1c4-4cda-871e-19fd6f83f8de", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41262025-04-30T06:29:48.815ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
41272025-04-30T06:29:48.818ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b98d243b-e2d5-4327-b752-ba9c1883dde0", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41282025-04-30T06:29:48.819ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
41292025-04-30T06:29:48.821ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4e669bc-3840-433d-bc6c-a7e015365796", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41302025-04-30T06:29:48.821ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
41312025-04-30T06:29:48.831ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "111b1cc0-bedf-47da-8aec-2b0c665eed31", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41322025-04-30T06:29:48.831ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
41332025-04-30T06:29:48.839ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "35a8eb9e-fdcd-4abe-89be-311ca21e6445", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41342025-04-30T06:29:48.839ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
41352025-04-30T06:29:48.843ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a02ab55b-5f00-4f4d-96b8-0a4f97044aaf", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41362025-04-30T06:29:48.843ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
41372025-04-30T06:29:48.846ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3218e37f-eec9-428c-a023-2104cdd5805c", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41382025-04-30T06:29:48.846ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
41392025-04-30T06:29:48.849ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "41592774-f340-448d-a0de-bf14bcd025d8", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41402025-04-30T06:29:48.849ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
41412025-04-30T06:29:48.852ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "19856642-f381-428b-a722-94d6fcf169d3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41422025-04-30T06:29:48.852ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
41432025-04-30T06:29:48.853ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
41442025-04-30T06:29:48.854ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c9df1d7-91a3-4c4c-9775-8d4e9b1aba3f", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41452025-04-30T06:29:48.854ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
41462025-04-30T06:29:48.856ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1146d59-db49-431e-bf23-60186379af70", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41472025-04-30T06:29:48.856ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
41482025-04-30T06:29:48.862ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3157f5e-7fcf-4e6f-a9e8-9ac0acc3d291", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41492025-04-30T06:29:48.862ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
41502025-04-30T06:29:48.864ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "35d999e8-a71d-45c0-b4a8-f5f7f70d4501", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41512025-04-30T06:29:48.864ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
41522025-04-30T06:29:48.866ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "82290417-873a-4ddf-9414-2bf11ae7b350", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41532025-04-30T06:29:48.866ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
41542025-04-30T06:29:48.868ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bea023e-28be-4b8c-939d-73cc2ca2325d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41552025-04-30T06:29:48.868ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
41562025-04-30T06:29:48.871ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "99cc0010-6c6b-4b29-ad22-e2c60316c517", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41572025-04-30T06:29:48.872ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
41582025-04-30T06:29:48.875ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cc7cf0f-e404-4695-96f0-79bb863fcdb1", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41592025-04-30T06:29:48.875ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
41602025-04-30T06:29:48.877ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "50b8c099-7efc-497a-ae93-beea3554d86f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41612025-04-30T06:29:48.877ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
41622025-04-30T06:29:48.878ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc817fd3-575a-4068-a5e0-5d7f44a469fd", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41632025-04-30T06:29:48.878ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
41642025-04-30T06:29:48.879ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "84d596f1-45d6-4313-b006-d8bb67a0f8ce", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41652025-04-30T06:29:48.879ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
41662025-04-30T06:29:48.888ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dfc419d-156e-4a02-ae6b-1461a9dc10a8", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41672025-04-30T06:29:48.891ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
41682025-04-30T06:29:48.896ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f51a11ba-d8bb-4942-84e8-bb2c12dc3a67", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41692025-04-30T06:29:48.900ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
41702025-04-30T06:29:48.902ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "78b03794-9fdd-4a39-85db-5e4744578967", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41712025-04-30T06:29:48.902ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
41722025-04-30T06:29:48.904ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
41732025-04-30T06:29:48.904ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41742025-04-30T06:29:48.904ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
41752025-04-30T06:29:48.904ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
41762025-04-30T06:29:48.905ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
41772025-04-30T06:29:48.906ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6e01ad3-58ba-491c-8280-72df800eaa00", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41782025-04-30T06:29:48.906ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
41792025-04-30T06:29:48.908ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41802025-04-30T06:29:48.914ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
41812025-04-30T06:29:48.950ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
41822025-04-30T06:29:48.950ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
41832025-04-30T06:29:48.950ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
41842025-04-30T06:29:48.953ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "24dd556d-1e41-4ab9-9c6d-3c7373e2c97d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41852025-04-30T06:29:48.953ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
41862025-04-30T06:29:48.953ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
41872025-04-30T06:29:48.954ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
41882025-04-30T06:29:48.954ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
41892025-04-30T06:29:48.956ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "63f30d33-e730-4e63-8918-8628945f3a20", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41902025-04-30T06:29:48.956ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
41912025-04-30T06:29:48.958ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dfbb590-ff7a-4c9c-9cbe-abc2e4347701", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41922025-04-30T06:29:48.959ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
41932025-04-30T06:29:48.961ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "06e0c96f-754e-4cf9-bdcf-8f1958b22187", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41942025-04-30T06:29:48.961ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
41952025-04-30T06:29:48.964ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "de49b5fa-de74-4338-ad9c-f19dab88aeda", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41962025-04-30T06:29:48.964ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
41972025-04-30T06:29:48.967ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ee7cd58-3b9a-40da-ae1d-091c3c6abb90", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
41982025-04-30T06:29:48.967ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
41992025-04-30T06:29:48.968ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5119fd7-1bd6-49b3-8e69-b6cdbe380c2a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42002025-04-30T06:29:48.969ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
42012025-04-30T06:29:48.971ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6baa5cec-f2b8-43b1-bf45-07860beb6bcf", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42022025-04-30T06:29:48.971ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
42032025-04-30T06:29:48.972ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "329eddd3-8957-496e-82cd-8d4fff0bd498", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42042025-04-30T06:29:48.972ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
42052025-04-30T06:29:48.974ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dae57ec1-468c-45b8-a9c8-b64506080125", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42062025-04-30T06:29:48.974ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
42072025-04-30T06:29:48.977ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "42ec3786-0afc-4f87-981c-d8cbfdca6263", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42082025-04-30T06:29:48.977ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
42092025-04-30T06:29:48.979ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "127f9e72-cfe0-413a-9c1c-1d3c75320b90", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42102025-04-30T06:29:48.979ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
42112025-04-30T06:29:48.983ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
42122025-04-30T06:29:48.985ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5517f7c5-8bfd-4e0a-bcfa-ebfa3da4925a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42132025-04-30T06:29:48.985ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
42142025-04-30T06:29:48.988ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2f3997a-c6e1-4f87-aff0-8d6ef50b84f2", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42152025-04-30T06:29:48.988ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
42162025-04-30T06:29:48.991ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2b94796-685c-4059-91e9-f641d35000de", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42172025-04-30T06:29:48.991ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
42182025-04-30T06:29:48.992ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "07fe08c5-0227-4cef-9f9f-f1249789a801", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42192025-04-30T06:29:48.992ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
42202025-04-30T06:29:48.993ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "df95a20f-0623-4744-83be-76505669a8dc", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42212025-04-30T06:29:48.993ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
42222025-04-30T06:29:48.995ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "892374b1-9790-4297-bf4b-3bb9b0970190", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42232025-04-30T06:29:48.995ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
42242025-04-30T06:29:48.996ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c80d8f5b-3f85-4565-b8cb-71206135e2a7", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42252025-04-30T06:29:48.996ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
42262025-04-30T06:29:48.997ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba67f3ce-8df0-4873-8814-88fb4017cbc8", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42272025-04-30T06:29:48.997ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
42282025-04-30T06:29:48.997ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42292025-04-30T06:29:48.997ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
42302025-04-30T06:29:48.997ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42312025-04-30T06:29:48.998ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42322025-04-30T06:29:49.010ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42332025-04-30T06:29:49.018ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
42342025-04-30T06:29:49.018ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
42352025-04-30T06:29:49.018ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42362025-04-30T06:29:49.018ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
42372025-04-30T06:29:49.018ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42382025-04-30T06:29:49.018ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42392025-04-30T06:29:49.029ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42402025-04-30T06:29:49.034ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
42412025-04-30T06:29:49.034ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
42422025-04-30T06:29:49.034ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42432025-04-30T06:29:49.035ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42442025-04-30T06:29:49.036ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
42452025-04-30T06:29:49.036ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42462025-04-30T06:29:49.036ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
42472025-04-30T06:29:49.036ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
42482025-04-30T06:29:49.038ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
42492025-04-30T06:29:49.043ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42502025-04-30T06:29:49.049ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
42512025-04-30T06:29:49.049ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
42522025-04-30T06:29:49.049ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
42532025-04-30T06:29:49.050ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
42542025-04-30T06:29:49.106ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
42552025-04-30T06:29:49.106ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
42562025-04-30T06:29:49.110ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:59372 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
42572025-04-30T06:29:49.113ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
42582025-04-30T06:29:49.113ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
42592025-04-30T06:29:49.114ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
42602025-04-30T06:29:49.120ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:59372 req_id = c1e0cad4-805b-4fcc-865f-baa0f5dea387 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
42612025-04-30T06:29:49.127ZINFOtest_image_create (dropshot): request completed latency_us = 7195 local_addr = [::1]:42828 method = GET remote_addr = [::1]:59372 req_id = c1e0cad4-805b-4fcc-865f-baa0f5dea387 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
42622025-04-30T06:29:49.128ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1e0cad4-805b-4fcc-865f-baa0f5dea387", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
42632025-04-30T06:29:49.131ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
42642025-04-30T06:29:49.131ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
42652025-04-30T06:29:49.131ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
42662025-04-30T06:29:49.135ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
42672025-04-30T06:29:49.143ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42682025-04-30T06:29:49.147ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
42692025-04-30T06:29:49.148ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42702025-04-30T06:29:49.148ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42712025-04-30T06:29:49.154ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42722025-04-30T06:29:49.161ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
42732025-04-30T06:29:49.162ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
42742025-04-30T06:29:49.162ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42752025-04-30T06:29:49.163ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42762025-04-30T06:29:49.235ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
42772025-04-30T06:29:49.239ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
42782025-04-30T06:29:49.239ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
42792025-04-30T06:29:49.239ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 533.309273ms iteration = 8 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
42802025-04-30T06:29:49.239ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 9 reason = Signaled
42812025-04-30T06:29:49.239ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
42822025-04-30T06:29:49.239ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42832025-04-30T06:29:49.239ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
42842025-04-30T06:29:49.239ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42852025-04-30T06:29:49.240ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42862025-04-30T06:29:49.244ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42872025-04-30T06:29:49.248ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
42882025-04-30T06:29:49.248ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
42892025-04-30T06:29:49.248ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42902025-04-30T06:29:49.249ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42912025-04-30T06:29:49.253ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
42922025-04-30T06:29:49.253ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
42932025-04-30T06:29:49.253ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 29 1b 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 )............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:50829 req_id = 810e2b98-0e4d-4369-b690-9dde9f58eb60
42942025-04-30T06:29:49.254ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 10523,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50829 req_id = 810e2b98-0e4d-4369-b690-9dde9f58eb60
42952025-04-30T06:29:49.254ZDEBGtest_image_create (store): query key key = _mgs._tcp
42962025-04-30T06:29:49.254ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
42972025-04-30T06:29:49.255ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:50829 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 810e2b98-0e4d-4369-b690-9dde9f58eb60
42982025-04-30T06:29:49.255ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3454, tv_nsec: 54376720 } })
42992025-04-30T06:29:49.255ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
43002025-04-30T06:29:49.255ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 99 73 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .s..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:59743 req_id = c3c5022c-92a8-4cea-808f-aef136012dd0
43012025-04-30T06:29:49.256ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 39283,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59743 req_id = c3c5022c-92a8-4cea-808f-aef136012dd0
43022025-04-30T06:29:49.256ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
43032025-04-30T06:29:49.256ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59743 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = c3c5022c-92a8-4cea-808f-aef136012dd0
43042025-04-30T06:29:49.309ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
43052025-04-30T06:29:49.309ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
43062025-04-30T06:29:49.309ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43072025-04-30T06:29:49.309ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
43082025-04-30T06:29:49.309ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
43092025-04-30T06:29:49.310ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
43102025-04-30T06:29:49.310ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
43112025-04-30T06:29:49.311ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
43122025-04-30T06:29:49.313ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 323b7ecd-f7ab-4f86-977b-7340c56e93c1 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
43132025-04-30T06:29:49.313ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 6a 31 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c j1..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:55732 req_id = 12f0e4e7-0fc6-4e39-8a21-ee59d8bf5ae4
43142025-04-30T06:29:49.313ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 27185,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55732 req_id = 12f0e4e7-0fc6-4e39-8a21-ee59d8bf5ae4
43152025-04-30T06:29:49.313ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
43162025-04-30T06:29:49.313ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27185, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:55732 req_id = 12f0e4e7-0fc6-4e39-8a21-ee59d8bf5ae4
43172025-04-30T06:29:49.313ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 323b7ecd-f7ab-4f86-977b-7340c56e93c1 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
43182025-04-30T06:29:49.313ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 323b7ecd-f7ab-4f86-977b-7340c56e93c1 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
43192025-04-30T06:29:49.313ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 323b7ecd-f7ab-4f86-977b-7340c56e93c1 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
43202025-04-30T06:29:49.313ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43212025-04-30T06:29:49.322ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
43222025-04-30T06:29:49.322ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
43232025-04-30T06:29:49.322ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
43242025-04-30T06:29:49.322ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
43252025-04-30T06:29:49.322ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
43262025-04-30T06:29:49.322ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
43272025-04-30T06:29:49.322ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
43282025-04-30T06:29:49.326ZINFOtest_image_create (dropshot_internal): request completed latency_us = 13990 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 323b7ecd-f7ab-4f86-977b-7340c56e93c1 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
43292025-04-30T06:29:49.328ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
43302025-04-30T06:29:49.328ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
43312025-04-30T06:29:49.328ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
43322025-04-30T06:29:49.329ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "323b7ecd-f7ab-4f86-977b-7340c56e93c1", "content-length": "405", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43332025-04-30T06:29:49.329ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
43342025-04-30T06:29:49.331ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = fe1c068c-7a29-49a7-97cf-069482dddfb3 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
43352025-04-30T06:29:49.333ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = fe1c068c-7a29-49a7-97cf-069482dddfb3 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
43362025-04-30T06:29:49.333ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = fe1c068c-7a29-49a7-97cf-069482dddfb3 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
43372025-04-30T06:29:49.334ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = fe1c068c-7a29-49a7-97cf-069482dddfb3 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
43382025-04-30T06:29:49.335ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0aa16b1-ee45-4cad-ae40-f4c421969353", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43392025-04-30T06:29:49.353ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
43402025-04-30T06:29:49.358ZINFOtest_image_create (dropshot_internal): request completed latency_us = 27360 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = fe1c068c-7a29-49a7-97cf-069482dddfb3 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
43412025-04-30T06:29:49.359ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe1c068c-7a29-49a7-97cf-069482dddfb3", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43422025-04-30T06:29:49.359ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
43432025-04-30T06:29:49.359ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
43442025-04-30T06:29:49.359ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
43452025-04-30T06:29:49.359ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa724e2e-e819-4cc7-adb8-762ca8484749", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43462025-04-30T06:29:49.359ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
43472025-04-30T06:29:49.364ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "23b57348-676e-449e-ab69-1a802af9799d", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43482025-04-30T06:29:49.365ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
43492025-04-30T06:29:49.367ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3274b608-e515-48ea-afb6-1ab98f56d16c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43502025-04-30T06:29:49.367ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
43512025-04-30T06:29:49.369ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca731a6e-43a5-4f14-84cf-bd4cd2f52421", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43522025-04-30T06:29:49.370ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
43532025-04-30T06:29:49.372ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "237b8550-f536-4e0c-b2bf-969f85abd100", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43542025-04-30T06:29:49.372ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
43552025-04-30T06:29:49.375ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e389453b-6771-43b7-86e6-223af83fe80f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43562025-04-30T06:29:49.375ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
43572025-04-30T06:29:49.377ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "71813895-8cf4-4d67-9893-a95ff551598a", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43582025-04-30T06:29:49.377ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
43592025-04-30T06:29:49.379ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6909a93d-f3fc-4ab4-8e3c-a1faa461b91d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43602025-04-30T06:29:49.379ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
43612025-04-30T06:29:49.380ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a56f9ac-afc9-486f-98d5-3dae74f23bf3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43622025-04-30T06:29:49.380ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
43632025-04-30T06:29:49.381ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "335fbc60-64dc-4acf-bfa5-e8ec2140a31c", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43642025-04-30T06:29:49.381ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
43652025-04-30T06:29:49.382ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5262409-a87d-4205-9824-a1651eace51a", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43662025-04-30T06:29:49.383ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
43672025-04-30T06:29:49.387ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
43682025-04-30T06:29:49.388ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae53f198-b92f-49fe-aa9d-9688c5457b9a", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43692025-04-30T06:29:49.388ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
43702025-04-30T06:29:49.390ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aed9e181-0b4d-4677-9946-05b0a933b8e9", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43712025-04-30T06:29:49.390ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
43722025-04-30T06:29:49.392ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e99461fc-d893-4a4a-9cad-82c1e431a936", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43732025-04-30T06:29:49.392ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
43742025-04-30T06:29:49.394ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a094b3f-c620-4a12-98b6-980afa8e1297", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43752025-04-30T06:29:49.394ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
43762025-04-30T06:29:49.396ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c471bb2-2090-41fc-b8b8-7482c782e49f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43772025-04-30T06:29:49.396ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
43782025-04-30T06:29:49.398ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b234f0e-1117-4dc7-b2ce-e9272c6d8c40", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43792025-04-30T06:29:49.398ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
43802025-04-30T06:29:49.400ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "79529e70-5670-40ea-be89-4f5ae3f7fb20", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43812025-04-30T06:29:49.400ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
43822025-04-30T06:29:49.401ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7317fa57-3129-44c1-a721-6879bdac21a4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43832025-04-30T06:29:49.402ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
43842025-04-30T06:29:49.402ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d45dbb2-180f-4bfd-b225-eafe5983b809", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43852025-04-30T06:29:49.403ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
43862025-04-30T06:29:49.403ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "83c4e892-6b35-4ecb-8dcb-89768cc28ccc", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43872025-04-30T06:29:49.404ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
43882025-04-30T06:29:49.442ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
43892025-04-30T06:29:49.442ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43902025-04-30T06:29:49.442ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
43912025-04-30T06:29:49.442ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
43922025-04-30T06:29:49.444ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
43932025-04-30T06:29:49.446ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
43942025-04-30T06:29:49.446ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
43952025-04-30T06:29:49.448ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "149470d9-f78d-4df4-8f3d-0ac986513746", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
43962025-04-30T06:29:49.449ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
43972025-04-30T06:29:49.450ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
43982025-04-30T06:29:49.450ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
43992025-04-30T06:29:49.450ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
44002025-04-30T06:29:49.450ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
44012025-04-30T06:29:49.450ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022025-04-30T06:29:49.457ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
44032025-04-30T06:29:49.457ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
44042025-04-30T06:29:49.457ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
44052025-04-30T06:29:49.457ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
44062025-04-30T06:29:49.461ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5abd176-3022-4da3-9615-c448f977770f", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44072025-04-30T06:29:49.461ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
44082025-04-30T06:29:49.467ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
44092025-04-30T06:29:49.467ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
44102025-04-30T06:29:49.467ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
44112025-04-30T06:29:49.476ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bd39903-4ce8-435e-8d5e-a017805156f6", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44122025-04-30T06:29:49.476ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
44132025-04-30T06:29:49.478ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d91d3b8b-0ec7-4922-92b7-9440aeefb7e8", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44142025-04-30T06:29:49.479ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
44152025-04-30T06:29:49.513ZDEBGtest_image_create (results-sink): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
44162025-04-30T06:29:49.513ZDEBGtest_image_create (results-sink-cluster): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
44172025-04-30T06:29:49.514ZDEBGtest_image_create (clickhouse-client): unrolling 2 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
44182025-04-30T06:29:49.515ZDEBGtest_image_create (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
44192025-04-30T06:29:49.515ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = SELECT * FROM oximeter.timeseries_schema FORMAT Native;
44202025-04-30T06:29:49.518ZTRACtest_image_create (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
44212025-04-30T06:29:49.518ZDEBGtest_image_create (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc schema = TimeseriesSchema { timeseries_name: TimeseriesName("integration_target:integration_metric"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "metric_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-04-30T06:29:49.515392800Z } timeseries_name = integration_target:integration_metric
44222025-04-30T06:29:49.519ZDEBGtest_image_create (clickhouse-client): inserting 1 new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
44232025-04-30T06:29:49.519ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 6 n_rows = 1 sql = INSERT INTO oximeter.timeseries_schema FORMAT Native
44242025-04-30T06:29:49.520ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b1abe11-8cd1-486c-8fb0-50c6a7ac5ac0", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44252025-04-30T06:29:49.520ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
44262025-04-30T06:29:49.524ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
44272025-04-30T06:29:49.534ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
44282025-04-30T06:29:49.535ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
44292025-04-30T06:29:49.535ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
44302025-04-30T06:29:49.542ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = measurements_i64
44312025-04-30T06:29:49.542ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
44322025-04-30T06:29:49.544ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b441ff3e-9242-4448-89ac-c119b5a54167", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44332025-04-30T06:29:49.545ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
44342025-04-30T06:29:49.546ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1bc44c1-cb7c-4b5e-8db7-688e120c0dff", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44352025-04-30T06:29:49.546ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
44362025-04-30T06:29:49.548ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "564b2a91-efab-4511-8763-e9358ba79538", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44372025-04-30T06:29:49.548ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
44382025-04-30T06:29:49.549ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd7be043-c24a-4c31-b1da-756c1f90a3a8", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44392025-04-30T06:29:49.549ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
44402025-04-30T06:29:49.550ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9425016-2ed3-40ae-8396-3d04c2b5304e", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44412025-04-30T06:29:49.550ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
44422025-04-30T06:29:49.551ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fadb589e-b4e3-45d5-a887-5aff9d1cec52", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44432025-04-30T06:29:49.552ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
44442025-04-30T06:29:49.554ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b67578d-5c46-45cc-821e-3134fcf5518b", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44452025-04-30T06:29:49.554ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
44462025-04-30T06:29:49.555ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4646ed33-b63b-4930-b820-11aaf5cd12d8", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44472025-04-30T06:29:49.556ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
44482025-04-30T06:29:49.557ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccc7503d-3b66-498e-9047-4a4830493975", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44492025-04-30T06:29:49.557ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
44502025-04-30T06:29:49.561ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "56ef3a79-b05a-4ddc-adb5-80c6150a299f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44512025-04-30T06:29:49.562ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
44522025-04-30T06:29:49.566ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0924e16-8056-4051-b953-379c3f858ad5", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44532025-04-30T06:29:49.566ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
44542025-04-30T06:29:49.568ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0d7493f-65e7-4d44-9e9a-f82ef27521da", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44552025-04-30T06:29:49.569ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
44562025-04-30T06:29:49.571ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e89f00-ed1d-4368-8f04-d81888e3e3d0", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44572025-04-30T06:29:49.571ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
44582025-04-30T06:29:49.574ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "70b7ed25-ba3c-4cd5-8917-6dbdd67c3fe5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44592025-04-30T06:29:49.574ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
44602025-04-30T06:29:49.577ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "57da628e-c9d1-4f14-a658-65df9d46ffd0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44612025-04-30T06:29:49.580ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
44622025-04-30T06:29:49.581ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0093d700-6b5d-476b-9e01-09540825f373", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44632025-04-30T06:29:49.582ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
44642025-04-30T06:29:49.584ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6c444cc-4190-49c8-81fe-acf0720ea65f", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44652025-04-30T06:29:49.584ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
44662025-04-30T06:29:49.585ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
44672025-04-30T06:29:49.585ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44682025-04-30T06:29:49.585ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
44692025-04-30T06:29:49.585ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
44702025-04-30T06:29:49.586ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
44712025-04-30T06:29:49.589ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a814e92e-9019-4c55-8d26-4bafe505c09c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:48 GMT"} })
44722025-04-30T06:29:49.589ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
44732025-04-30T06:29:49.589ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44742025-04-30T06:29:49.590ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
44752025-04-30T06:29:49.590ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44762025-04-30T06:29:49.591ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44772025-04-30T06:29:49.592ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782025-04-30T06:29:49.598ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
44792025-04-30T06:29:49.598ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
44802025-04-30T06:29:49.598ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
44812025-04-30T06:29:49.599ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
44822025-04-30T06:29:49.604ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44832025-04-30T06:29:49.608ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
44842025-04-30T06:29:49.608ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
44852025-04-30T06:29:49.609ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44862025-04-30T06:29:49.609ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
44872025-04-30T06:29:49.609ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44882025-04-30T06:29:49.611ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44892025-04-30T06:29:49.615ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
44902025-04-30T06:29:49.615ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
44912025-04-30T06:29:49.616ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
44922025-04-30T06:29:49.617ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
44932025-04-30T06:29:49.621ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44942025-04-30T06:29:49.628ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
44952025-04-30T06:29:49.628ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
44962025-04-30T06:29:49.628ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44972025-04-30T06:29:49.631ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44982025-04-30T06:29:49.701ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
44992025-04-30T06:29:49.701ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
45002025-04-30T06:29:49.703ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:36086 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
45012025-04-30T06:29:49.705ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:36086 req_id = b2fe782f-4e31-4239-a4cc-9aa7698569cf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
45022025-04-30T06:29:49.706ZINFOtest_image_create (dropshot): request completed latency_us = 1081 local_addr = [::1]:42828 method = GET remote_addr = [::1]:36086 req_id = b2fe782f-4e31-4239-a4cc-9aa7698569cf response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
45032025-04-30T06:29:49.707ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2fe782f-4e31-4239-a4cc-9aa7698569cf", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45042025-04-30T06:29:49.713ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
45052025-04-30T06:29:49.713ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
45062025-04-30T06:29:49.713ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
45072025-04-30T06:29:49.717ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
45082025-04-30T06:29:49.717ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45092025-04-30T06:29:49.717ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
45102025-04-30T06:29:49.717ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45112025-04-30T06:29:49.718ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45122025-04-30T06:29:49.723ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45132025-04-30T06:29:49.730ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
45142025-04-30T06:29:49.730ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
45152025-04-30T06:29:49.730ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45162025-04-30T06:29:49.731ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45172025-04-30T06:29:49.757ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
45182025-04-30T06:29:49.771ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
45192025-04-30T06:29:49.771ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
45202025-04-30T06:29:49.771ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 532.417898ms iteration = 9 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
45212025-04-30T06:29:49.772ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 10 reason = Signaled
45222025-04-30T06:29:49.772ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
45232025-04-30T06:29:49.772ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45242025-04-30T06:29:49.772ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
45252025-04-30T06:29:49.772ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45262025-04-30T06:29:49.774ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45272025-04-30T06:29:49.776ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45282025-04-30T06:29:49.784ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
45292025-04-30T06:29:49.784ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
45302025-04-30T06:29:49.784ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45312025-04-30T06:29:49.785ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45322025-04-30T06:29:49.789ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
45332025-04-30T06:29:49.789ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
45342025-04-30T06:29:49.790ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 66 39 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 f9..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:54367 req_id = 41e0c15f-5b97-4b23-8697-90b2d6f4f8a9
45352025-04-30T06:29:49.790ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 26169,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54367 req_id = 41e0c15f-5b97-4b23-8697-90b2d6f4f8a9
45362025-04-30T06:29:49.790ZDEBGtest_image_create (store): query key key = _mgs._tcp
45372025-04-30T06:29:49.791ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
45382025-04-30T06:29:49.791ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:54367 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 41e0c15f-5b97-4b23-8697-90b2d6f4f8a9
45392025-04-30T06:29:49.791ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3454, tv_nsec: 590422557 } })
45402025-04-30T06:29:49.791ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
45412025-04-30T06:29:49.792ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: cc 36 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .6..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:62401 req_id = 9b0983ca-7c28-4676-8e62-2c4226fe6f81
45422025-04-30T06:29:49.792ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52278,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62401 req_id = 9b0983ca-7c28-4676-8e62-2c4226fe6f81
45432025-04-30T06:29:49.792ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
45442025-04-30T06:29:49.792ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62401 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 9b0983ca-7c28-4676-8e62-2c4226fe6f81
45452025-04-30T06:29:49.872ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
45462025-04-30T06:29:49.873ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
45472025-04-30T06:29:49.873ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45482025-04-30T06:29:49.873ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
45492025-04-30T06:29:49.873ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
45502025-04-30T06:29:49.874ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
45512025-04-30T06:29:49.875ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 4e ef 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c N............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:54793 req_id = 2ac8b7d0-e44b-4124-834a-c7cb106ad846
45522025-04-30T06:29:49.875ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 20207,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54793 req_id = 2ac8b7d0-e44b-4124-834a-c7cb106ad846
45532025-04-30T06:29:49.876ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
45542025-04-30T06:29:49.876ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20207, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:54793 req_id = 2ac8b7d0-e44b-4124-834a-c7cb106ad846
45552025-04-30T06:29:49.877ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
45562025-04-30T06:29:49.877ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
45572025-04-30T06:29:49.877ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
45582025-04-30T06:29:49.879ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45592025-04-30T06:29:49.894ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
45602025-04-30T06:29:49.894ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
45612025-04-30T06:29:49.894ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
45622025-04-30T06:29:49.896ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
45632025-04-30T06:29:49.896ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "80810405-5dd1-45b4-b92d-b82cb6978a3d", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45642025-04-30T06:29:49.897ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
45652025-04-30T06:29:49.900ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
45662025-04-30T06:29:49.900ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
45672025-04-30T06:29:49.902ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
45682025-04-30T06:29:49.912ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cd23c81-b370-459e-bf0c-8fd19798705b", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45692025-04-30T06:29:49.912ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
45702025-04-30T06:29:49.918ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7649f078-c9f2-41a6-8f32-676e1a426b5c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45712025-04-30T06:29:49.920ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
45722025-04-30T06:29:49.927ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c795beaf-cbcd-4604-8239-c459b6908545", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45732025-04-30T06:29:49.928ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
45742025-04-30T06:29:49.934ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea09380c-820f-46a0-8849-562077c466f4", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45752025-04-30T06:29:49.934ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
45762025-04-30T06:29:49.938ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af0c2dc2-bb71-4a67-ab72-9fcc2ed18d14", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45772025-04-30T06:29:49.938ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
45782025-04-30T06:29:49.942ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
45792025-04-30T06:29:49.944ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b17001f1-6568-47f5-8de3-1e86d20d1bf8", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45802025-04-30T06:29:49.945ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
45812025-04-30T06:29:49.947ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53d53ce-4608-408b-85eb-4233456a7623", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45822025-04-30T06:29:49.947ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
45832025-04-30T06:29:49.949ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cc86506-2b81-4074-a17c-67376f107467", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45842025-04-30T06:29:49.949ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
45852025-04-30T06:29:49.950ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "25d89db3-5968-4dac-a861-2f2078736b04", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45862025-04-30T06:29:49.950ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
45872025-04-30T06:29:49.951ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0eef224-a9bd-4745-9564-b23263303a6f", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45882025-04-30T06:29:49.951ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
45892025-04-30T06:29:49.956ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f44d42c0-b83a-444e-986f-d05379096a98", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45902025-04-30T06:29:49.956ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
45912025-04-30T06:29:49.958ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c663ca1-d78e-4bcb-a9be-5e7a9aab3a7a", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45922025-04-30T06:29:49.959ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
45932025-04-30T06:29:49.961ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "104227bf-0bef-4ac3-b0a1-b777942bd45a", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45942025-04-30T06:29:49.962ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
45952025-04-30T06:29:49.965ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f1721c-73b6-4233-bd93-1785b8c85fa1", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45962025-04-30T06:29:49.965ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
45972025-04-30T06:29:49.970ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30094d9a-fbe7-4546-bb1f-bcd156efcca3", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
45982025-04-30T06:29:49.970ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
45992025-04-30T06:29:49.972ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c19978c-db24-4d58-8022-1670a18231f8", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46002025-04-30T06:29:49.973ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
46012025-04-30T06:29:49.975ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "35852e2b-4643-4c74-8167-d1f73450b508", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46022025-04-30T06:29:49.975ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
46032025-04-30T06:29:49.978ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "25de518e-b913-465d-b36e-9f0dbf85ec0b", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46042025-04-30T06:29:49.979ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
46052025-04-30T06:29:49.980ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "475f53ed-b8b8-43d6-b3ad-77e7c8ae1740", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46062025-04-30T06:29:49.980ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
46072025-04-30T06:29:49.981ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "756ee42c-3d14-4b5d-b564-5387fae3539f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46082025-04-30T06:29:49.981ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
46092025-04-30T06:29:49.983ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a0898de-ab51-44bd-8bed-9df6b82b9b43", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46102025-04-30T06:29:49.983ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
46112025-04-30T06:29:49.984ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "25645db5-3e10-414a-b098-f7884db37d35", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46122025-04-30T06:29:49.985ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
46132025-04-30T06:29:49.986ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "38b98eae-8654-4bbe-a4dd-ce03f90b4ddc", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46142025-04-30T06:29:49.988ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
46152025-04-30T06:29:49.992ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a75cd1c9-cd3b-43d5-b7ac-69ee763911dc", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46162025-04-30T06:29:49.992ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
46172025-04-30T06:29:49.996ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
46182025-04-30T06:29:49.996ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46192025-04-30T06:29:49.996ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
46202025-04-30T06:29:49.996ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
46212025-04-30T06:29:49.997ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
46222025-04-30T06:29:50.001ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c487655b-2bd0-4675-af08-aa291bc01335", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46232025-04-30T06:29:50.001ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
46242025-04-30T06:29:50.002ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46252025-04-30T06:29:50.016ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
46262025-04-30T06:29:50.017ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
46272025-04-30T06:29:50.017ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
46282025-04-30T06:29:50.017ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
46292025-04-30T06:29:50.021ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5166339-46cf-4119-bcc9-f2a799c5fe37", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46302025-04-30T06:29:50.021ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
46312025-04-30T06:29:50.022ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
46322025-04-30T06:29:50.022ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
46332025-04-30T06:29:50.023ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
46342025-04-30T06:29:50.025ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ca3b0c7-e5fd-484d-9adb-5f1de993ba11", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46352025-04-30T06:29:50.025ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
46362025-04-30T06:29:50.028ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f592951e-484d-4fab-8e38-73179036df2b", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46372025-04-30T06:29:50.028ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
46382025-04-30T06:29:50.032ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e164062b-0a29-4e99-8f51-3ea434db3281", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46392025-04-30T06:29:50.032ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
46402025-04-30T06:29:50.034ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "99da6b41-9a87-483d-bafb-83d6158c2b56", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46412025-04-30T06:29:50.034ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
46422025-04-30T06:29:50.035ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "888289b3-f1c8-4d67-923e-bfbf50772e21", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46432025-04-30T06:29:50.036ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
46442025-04-30T06:29:50.037ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eb1fceb-b126-4fd1-949b-ea78016c6dd0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46452025-04-30T06:29:50.037ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
46462025-04-30T06:29:50.039ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "110943f4-a052-43de-847a-b9794d35dabb", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46472025-04-30T06:29:50.039ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
46482025-04-30T06:29:50.043ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0519859a-0381-4514-8b44-0ef9665b93ec", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46492025-04-30T06:29:50.043ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
46502025-04-30T06:29:50.051ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae58f645-6989-4082-8772-504a00749c09", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46512025-04-30T06:29:50.051ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
46522025-04-30T06:29:50.053ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
46532025-04-30T06:29:50.056ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3e7fd41-ee4b-424c-a2bd-3f88c6a77af6", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46542025-04-30T06:29:50.056ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
46552025-04-30T06:29:50.058ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cef5a1a-c014-4381-8d3b-3b17fe24e7b8", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46562025-04-30T06:29:50.058ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
46572025-04-30T06:29:50.061ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7175eac-3f28-4432-be29-91beb8e5dc52", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46582025-04-30T06:29:50.061ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
46592025-04-30T06:29:50.070ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "44a41aba-3216-4c96-bfab-7a329dcf5fc3", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46602025-04-30T06:29:50.071ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
46612025-04-30T06:29:50.073ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c135a49-9757-4253-8598-cb66a12bc371", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46622025-04-30T06:29:50.073ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
46632025-04-30T06:29:50.074ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dabc2b00-c1c2-4069-82dc-769833753691", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46642025-04-30T06:29:50.074ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
46652025-04-30T06:29:50.075ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1a94bd8-ffdc-4ec1-a674-f43af3fb8618", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46662025-04-30T06:29:50.075ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
46672025-04-30T06:29:50.077ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "feaccce5-c133-4ea2-8ee3-5ac8a77371f6", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46682025-04-30T06:29:50.077ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
46692025-04-30T06:29:50.080ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c427d9f-0f4b-412a-98c7-e3f42edbdb3c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
46702025-04-30T06:29:50.080ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
46712025-04-30T06:29:50.080ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46722025-04-30T06:29:50.080ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
46732025-04-30T06:29:50.080ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
46742025-04-30T06:29:50.081ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
46752025-04-30T06:29:50.088ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46762025-04-30T06:29:50.095ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
46772025-04-30T06:29:50.095ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
46782025-04-30T06:29:50.095ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46792025-04-30T06:29:50.095ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
46802025-04-30T06:29:50.095ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
46812025-04-30T06:29:50.095ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
46822025-04-30T06:29:50.099ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832025-04-30T06:29:50.104ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
46842025-04-30T06:29:50.104ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
46852025-04-30T06:29:50.104ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
46862025-04-30T06:29:50.105ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
46872025-04-30T06:29:50.106ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
46882025-04-30T06:29:50.106ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46892025-04-30T06:29:50.106ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
46902025-04-30T06:29:50.106ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
46912025-04-30T06:29:50.107ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
46922025-04-30T06:29:50.174ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
46932025-04-30T06:29:50.174ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
46942025-04-30T06:29:50.174ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46952025-04-30T06:29:50.181ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
46962025-04-30T06:29:50.181ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
46972025-04-30T06:29:50.181ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
46982025-04-30T06:29:50.181ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
46992025-04-30T06:29:50.181ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:33213 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
47002025-04-30T06:29:50.183ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:33213 req_id = 495355fe-4c29-4ee0-8478-3a9af9c640d5 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
47012025-04-30T06:29:50.183ZINFOtest_image_create (dropshot): request completed latency_us = 518 local_addr = [::1]:42828 method = GET remote_addr = [::1]:33213 req_id = 495355fe-4c29-4ee0-8478-3a9af9c640d5 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
47022025-04-30T06:29:50.184ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "495355fe-4c29-4ee0-8478-3a9af9c640d5", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47032025-04-30T06:29:50.188ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47042025-04-30T06:29:50.189ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47052025-04-30T06:29:50.189ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
47062025-04-30T06:29:50.192ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
47072025-04-30T06:29:50.192ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47082025-04-30T06:29:50.192ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
47092025-04-30T06:29:50.192ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47102025-04-30T06:29:50.195ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47112025-04-30T06:29:50.197ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
47122025-04-30T06:29:50.197ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
47132025-04-30T06:29:50.198ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
47142025-04-30T06:29:50.201ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47152025-04-30T06:29:50.208ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
47162025-04-30T06:29:50.208ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
47172025-04-30T06:29:50.208ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47182025-04-30T06:29:50.209ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47192025-04-30T06:29:50.251ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
47202025-04-30T06:29:50.252ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
47212025-04-30T06:29:50.252ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 480.571648ms iteration = 10 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
47222025-04-30T06:29:50.252ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 11 reason = Signaled
47232025-04-30T06:29:50.252ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
47242025-04-30T06:29:50.252ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47252025-04-30T06:29:50.252ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
47262025-04-30T06:29:50.252ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47272025-04-30T06:29:50.253ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47282025-04-30T06:29:50.257ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
47292025-04-30T06:29:50.258ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47302025-04-30T06:29:50.263ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
47312025-04-30T06:29:50.264ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
47322025-04-30T06:29:50.264ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47332025-04-30T06:29:50.265ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47342025-04-30T06:29:50.268ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
47352025-04-30T06:29:50.268ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
47362025-04-30T06:29:50.269ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: f5 b4 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:58840 req_id = 5ae50291-aeda-49ca-9ba8-53f76904a8e7
47372025-04-30T06:29:50.269ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62900,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58840 req_id = 5ae50291-aeda-49ca-9ba8-53f76904a8e7
47382025-04-30T06:29:50.269ZDEBGtest_image_create (store): query key key = _mgs._tcp
47392025-04-30T06:29:50.270ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
47402025-04-30T06:29:50.270ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:58840 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 5ae50291-aeda-49ca-9ba8-53f76904a8e7
47412025-04-30T06:29:50.270ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3455, tv_nsec: 69777761 } })
47422025-04-30T06:29:50.270ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
47432025-04-30T06:29:50.271ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: a4 86 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:61942 req_id = 703c7854-819f-4b88-ae59-e673b75d5bae
47442025-04-30T06:29:50.271ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 42118,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61942 req_id = 703c7854-819f-4b88-ae59-e673b75d5bae
47452025-04-30T06:29:50.271ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
47462025-04-30T06:29:50.271ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:61942 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 703c7854-819f-4b88-ae59-e673b75d5bae
47472025-04-30T06:29:50.326ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
47482025-04-30T06:29:50.326ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
47492025-04-30T06:29:50.326ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47502025-04-30T06:29:50.326ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
47512025-04-30T06:29:50.326ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
47522025-04-30T06:29:50.327ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
47532025-04-30T06:29:50.327ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 63 36 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c c6..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:57286 req_id = 69b32448-a583-4466-b0d6-6f17f46b9f2a
47542025-04-30T06:29:50.328ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25398,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57286 req_id = 69b32448-a583-4466-b0d6-6f17f46b9f2a
47552025-04-30T06:29:50.328ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
47562025-04-30T06:29:50.328ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25398, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:57286 req_id = 69b32448-a583-4466-b0d6-6f17f46b9f2a
47572025-04-30T06:29:50.328ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
47582025-04-30T06:29:50.328ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
47592025-04-30T06:29:50.328ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
47602025-04-30T06:29:50.329ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47612025-04-30T06:29:50.336ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
47622025-04-30T06:29:50.336ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
47632025-04-30T06:29:50.336ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
47642025-04-30T06:29:50.337ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
47652025-04-30T06:29:50.338ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "15800c7f-799f-408f-a0a9-4fd8ac68c668", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47662025-04-30T06:29:50.338ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
47672025-04-30T06:29:50.339ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a668a924-0d36-45b1-b46d-fe0c902a9ee1", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47682025-04-30T06:29:50.340ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
47692025-04-30T06:29:50.342ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4718677a-5e9e-42dc-82de-534c86fb9d7b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47702025-04-30T06:29:50.342ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
47712025-04-30T06:29:50.343ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "82c7d170-8e47-4cbe-b4d4-e433f227930b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47722025-04-30T06:29:50.344ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
47732025-04-30T06:29:50.345ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
47742025-04-30T06:29:50.345ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
47752025-04-30T06:29:50.345ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
47762025-04-30T06:29:50.347ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "78a9f5e2-014e-4de9-bf49-022f413ded51", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47772025-04-30T06:29:50.347ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
47782025-04-30T06:29:50.352ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eeaa3f9-36b2-4b05-9b76-826e7d63db45", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47792025-04-30T06:29:50.352ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
47802025-04-30T06:29:50.354ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "290dd650-f232-43d9-b7d8-7d75b3ad1d48", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47812025-04-30T06:29:50.355ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
47822025-04-30T06:29:50.358ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "27ed8b9b-9af7-4000-adc3-01edc7d605a9", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47832025-04-30T06:29:50.358ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
47842025-04-30T06:29:50.359ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "06c55228-5080-4a11-a6b6-7d19debfe0e6", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47852025-04-30T06:29:50.359ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
47862025-04-30T06:29:50.361ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "edbbd2d7-f609-45b3-a083-b229fb8873d9", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47872025-04-30T06:29:50.361ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
47882025-04-30T06:29:50.371ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad3a08b4-a834-4430-afb7-3ce8ec6af0d4", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47892025-04-30T06:29:50.371ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
47902025-04-30T06:29:50.373ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "26643474-452e-4fec-bf74-0a45e9f964e6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47912025-04-30T06:29:50.373ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
47922025-04-30T06:29:50.375ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "40c84e37-bbeb-4f27-b906-fcc961029cc6", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47932025-04-30T06:29:50.375ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
47942025-04-30T06:29:50.384ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
47952025-04-30T06:29:50.385ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cbac1a9-6f6a-4a2a-9461-ef49a78a3730", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47962025-04-30T06:29:50.386ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
47972025-04-30T06:29:50.389ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f982d60d-525d-4cd0-830e-d23f249bb431", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
47982025-04-30T06:29:50.389ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
47992025-04-30T06:29:50.398ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad9adf6-7222-4f82-8284-3dd7b83e7f57", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48002025-04-30T06:29:50.398ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
48012025-04-30T06:29:50.400ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "34625b52-8fcc-4d74-bfb8-8591cf321db1", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48022025-04-30T06:29:50.402ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
48032025-04-30T06:29:50.404ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "efbe5bc7-2dae-4a69-8563-fb0f1a490cfe", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48042025-04-30T06:29:50.404ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
48052025-04-30T06:29:50.406ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7800474c-86dc-4f84-8d81-48cc169ac76f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48062025-04-30T06:29:50.406ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
48072025-04-30T06:29:50.407ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9444d9b5-e95e-41ce-927f-fded51a6b804", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48082025-04-30T06:29:50.407ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
48092025-04-30T06:29:50.409ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "70ad393d-8586-420e-bf2d-1c4d67859765", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48102025-04-30T06:29:50.409ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
48112025-04-30T06:29:50.410ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6e6ca04-8ad7-4058-a5b8-905e7f20675d", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48122025-04-30T06:29:50.410ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
48132025-04-30T06:29:50.411ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b4e009-0dac-4456-9b53-7cbc5eb4956c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48142025-04-30T06:29:50.411ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
48152025-04-30T06:29:50.413ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "98c2f0cb-a9e8-47ea-befa-40f5f87d043f", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48162025-04-30T06:29:50.413ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
48172025-04-30T06:29:50.415ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "07bd7297-66ca-4836-abc0-587037371917", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48182025-04-30T06:29:50.415ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
48192025-04-30T06:29:50.417ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3025b1c-5385-42c6-a171-a84d8c735e8a", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48202025-04-30T06:29:50.417ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
48212025-04-30T06:29:50.418ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
48222025-04-30T06:29:50.418ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
48232025-04-30T06:29:50.419ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
48242025-04-30T06:29:50.420ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
48252025-04-30T06:29:50.420ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
48262025-04-30T06:29:50.420ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
48272025-04-30T06:29:50.422ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "584fe0c6-59fc-4e60-9069-a323a894c2fc", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48282025-04-30T06:29:50.422ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
48292025-04-30T06:29:50.423ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ec5dfc8-0ea0-4ac9-9251-53971735f071", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48302025-04-30T06:29:50.424ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
48312025-04-30T06:29:50.426ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9d70855-21b6-4eba-a27b-f00cc0d8d2ed", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48322025-04-30T06:29:50.426ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
48332025-04-30T06:29:50.428ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "73aa6779-4f74-4726-be43-9bccdd0663c1", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48342025-04-30T06:29:50.428ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
48352025-04-30T06:29:50.429ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "94dcc64d-0f58-46ce-b06b-c2465e91f72f", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48362025-04-30T06:29:50.429ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
48372025-04-30T06:29:50.430ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "19478691-366b-43df-902f-4982583609ad", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48382025-04-30T06:29:50.430ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
48392025-04-30T06:29:50.432ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "82d4bc65-f68d-4297-85b3-4f5a16959f8b", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48402025-04-30T06:29:50.432ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
48412025-04-30T06:29:50.434ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1afdcd20-912b-4d24-aa6c-758c4c983947", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48422025-04-30T06:29:50.434ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
48432025-04-30T06:29:50.435ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
48442025-04-30T06:29:50.435ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48452025-04-30T06:29:50.435ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
48462025-04-30T06:29:50.435ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
48472025-04-30T06:29:50.436ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
48482025-04-30T06:29:50.436ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd89373f-6625-4447-a09b-4b49d0230dbd", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48492025-04-30T06:29:50.436ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
48502025-04-30T06:29:50.438ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48512025-04-30T06:29:50.444ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
48522025-04-30T06:29:50.444ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
48532025-04-30T06:29:50.444ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
48542025-04-30T06:29:50.445ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
48552025-04-30T06:29:50.445ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2746b4-cdb0-48eb-8d51-4f8c952a807d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48562025-04-30T06:29:50.445ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
48572025-04-30T06:29:50.449ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
48582025-04-30T06:29:50.449ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
48592025-04-30T06:29:50.449ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
48602025-04-30T06:29:50.450ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e15780db-d218-4729-b6a5-f616da586aea", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48612025-04-30T06:29:50.450ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
48622025-04-30T06:29:50.461ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd932afe-e759-4609-b6c4-0b5a42549704", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48632025-04-30T06:29:50.461ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
48642025-04-30T06:29:50.463ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3b795f1-2ead-42ce-875d-a3debf6362fa", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48652025-04-30T06:29:50.463ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
48662025-04-30T06:29:50.465ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf92d790-e8a3-4eae-9e47-d577a272859d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48672025-04-30T06:29:50.465ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
48682025-04-30T06:29:50.467ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8376744f-3193-401c-8830-12bbf778dbbe", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48692025-04-30T06:29:50.468ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
48702025-04-30T06:29:50.469ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6abe3f6c-48da-4930-bff3-182ea62529c6", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48712025-04-30T06:29:50.469ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
48722025-04-30T06:29:50.470ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5cccd59-d0aa-4553-a12d-6c9ae4814b86", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48732025-04-30T06:29:50.470ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
48742025-04-30T06:29:50.471ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc4681d6-4441-4901-9acb-03a169cce305", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48752025-04-30T06:29:50.471ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
48762025-04-30T06:29:50.472ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "17615d73-fc11-442e-a85d-b0bc6ddaf606", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
48772025-04-30T06:29:50.472ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
48782025-04-30T06:29:50.472ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48792025-04-30T06:29:50.472ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
48802025-04-30T06:29:50.472ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48812025-04-30T06:29:50.473ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
48822025-04-30T06:29:50.476ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48832025-04-30T06:29:50.482ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
48842025-04-30T06:29:50.482ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
48852025-04-30T06:29:50.482ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48862025-04-30T06:29:50.482ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
48872025-04-30T06:29:50.482ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48882025-04-30T06:29:50.483ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
48892025-04-30T06:29:50.490ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48902025-04-30T06:29:50.494ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
48912025-04-30T06:29:50.494ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
48922025-04-30T06:29:50.494ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48932025-04-30T06:29:50.494ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
48942025-04-30T06:29:50.501ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
48952025-04-30T06:29:50.521ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
48962025-04-30T06:29:50.521ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
48972025-04-30T06:29:50.521ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
48982025-04-30T06:29:50.523ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
48992025-04-30T06:29:50.533ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
49002025-04-30T06:29:50.534ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
49012025-04-30T06:29:50.537ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
49022025-04-30T06:29:50.537ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
49032025-04-30T06:29:50.553ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
49042025-04-30T06:29:50.553ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
49052025-04-30T06:29:50.553ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
49062025-04-30T06:29:50.553ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
49072025-04-30T06:29:50.554ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
49082025-04-30T06:29:50.557ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49092025-04-30T06:29:50.564ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
49102025-04-30T06:29:50.564ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
49112025-04-30T06:29:50.564ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
49122025-04-30T06:29:50.564ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
49132025-04-30T06:29:50.569ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
49142025-04-30T06:29:50.569ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
49152025-04-30T06:29:50.569ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
49162025-04-30T06:29:50.651ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
49172025-04-30T06:29:50.651ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
49182025-04-30T06:29:50.652ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:42123 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
49192025-04-30T06:29:50.653ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
49202025-04-30T06:29:50.654ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:42123 req_id = 5d7b8981-1f20-4ef0-b070-f26f6d2a75b9 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
49212025-04-30T06:29:50.657ZINFOtest_image_create (dropshot): request completed latency_us = 2695 local_addr = [::1]:42828 method = GET remote_addr = [::1]:42123 req_id = 5d7b8981-1f20-4ef0-b070-f26f6d2a75b9 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
49222025-04-30T06:29:50.659ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d7b8981-1f20-4ef0-b070-f26f6d2a75b9", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:49 GMT"} })
49232025-04-30T06:29:50.664ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
49242025-04-30T06:29:50.664ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
49252025-04-30T06:29:50.665ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
49262025-04-30T06:29:50.675ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
49272025-04-30T06:29:50.675ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
49282025-04-30T06:29:50.675ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
49292025-04-30T06:29:50.675ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
49302025-04-30T06:29:50.676ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
49312025-04-30T06:29:50.677ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
49322025-04-30T06:29:50.680ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332025-04-30T06:29:50.688ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
49342025-04-30T06:29:50.688ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
49352025-04-30T06:29:50.688ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
49362025-04-30T06:29:50.689ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
49372025-04-30T06:29:50.729ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
49382025-04-30T06:29:50.729ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
49392025-04-30T06:29:50.729ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
49402025-04-30T06:29:50.730ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
49412025-04-30T06:29:50.731ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
49422025-04-30T06:29:50.820ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49432025-04-30T06:29:50.840ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
49442025-04-30T06:29:50.841ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
49452025-04-30T06:29:50.841ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
49462025-04-30T06:29:50.841ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
49472025-04-30T06:29:50.966ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
49482025-04-30T06:29:50.967ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
49492025-04-30T06:29:50.967ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 714.580926ms iteration = 11 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
49502025-04-30T06:29:50.967ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 12 reason = Signaled
49512025-04-30T06:29:50.967ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
49522025-04-30T06:29:50.967ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
49532025-04-30T06:29:50.967ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
49542025-04-30T06:29:50.967ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
49552025-04-30T06:29:50.968ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
49562025-04-30T06:29:50.971ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
49572025-04-30T06:29:50.971ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
49582025-04-30T06:29:50.972ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
49592025-04-30T06:29:50.973ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49602025-04-30T06:29:50.977ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
49612025-04-30T06:29:50.977ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
49622025-04-30T06:29:50.977ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
49632025-04-30T06:29:50.978ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
49642025-04-30T06:29:50.991ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
49652025-04-30T06:29:50.991ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
49662025-04-30T06:29:50.996ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: eb ab 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:60315 req_id = d3d70143-4f0e-456b-8d1e-ed25ddba45cb
49672025-04-30T06:29:50.996ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60331,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60315 req_id = d3d70143-4f0e-456b-8d1e-ed25ddba45cb
49682025-04-30T06:29:50.996ZDEBGtest_image_create (store): query key key = _mgs._tcp
49692025-04-30T06:29:50.996ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
49702025-04-30T06:29:50.996ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:60315 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = d3d70143-4f0e-456b-8d1e-ed25ddba45cb
49712025-04-30T06:29:50.997ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3455, tv_nsec: 795983509 } })
49722025-04-30T06:29:50.997ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
49732025-04-30T06:29:50.999ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 5c 29 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e \\)..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:55912 req_id = 9809669a-5bea-4ec6-ac7f-801722d16190
49742025-04-30T06:29:50.999ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 23593,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55912 req_id = 9809669a-5bea-4ec6-ac7f-801722d16190
49752025-04-30T06:29:51.001ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
49762025-04-30T06:29:51.001ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:55912 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 9809669a-5bea-4ec6-ac7f-801722d16190
49772025-04-30T06:29:51.074ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
49782025-04-30T06:29:51.096ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: bd 52 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .R..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:61972 req_id = f3d32367-f044-45bf-9eb4-056b9f851176
49792025-04-30T06:29:51.097ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 48466,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61972 req_id = f3d32367-f044-45bf-9eb4-056b9f851176
49802025-04-30T06:29:51.097ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
49812025-04-30T06:29:51.099ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48466, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:61972 req_id = f3d32367-f044-45bf-9eb4-056b9f851176
49822025-04-30T06:29:51.099ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
49832025-04-30T06:29:51.099ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
49842025-04-30T06:29:51.099ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
49852025-04-30T06:29:51.105ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "07fbc982-f221-474c-b268-8bf1adc67021", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
49862025-04-30T06:29:51.105ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
49872025-04-30T06:29:51.109ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d6e6792-ab5c-489d-8dd3-09b6fd321da6", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
49882025-04-30T06:29:51.109ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
49892025-04-30T06:29:51.114ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfae27a6-cd67-4231-ab9b-b8107bd48491", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
49902025-04-30T06:29:51.115ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
49912025-04-30T06:29:51.120ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
49922025-04-30T06:29:51.122ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bbd7844-9e81-41ed-96a0-2c2d7a9e68d0", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
49932025-04-30T06:29:51.122ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
49942025-04-30T06:29:51.126ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "94a4283d-149a-4de8-8515-bd28ae71adcc", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
49952025-04-30T06:29:51.126ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
49962025-04-30T06:29:51.145ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "571195b0-dff7-4b2c-baba-cb6e352402db", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
49972025-04-30T06:29:51.146ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
49982025-04-30T06:29:51.150ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "176855da-eab1-4066-a0f0-399b9c76d5c4", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
49992025-04-30T06:29:51.150ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
50002025-04-30T06:29:51.152ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1ff2fe5-8d24-4b51-b7cd-b11abf599a43", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50012025-04-30T06:29:51.152ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
50022025-04-30T06:29:51.153ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8eb129a4-5253-4e69-bce1-c1b857508f53", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50032025-04-30T06:29:51.153ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
50042025-04-30T06:29:51.155ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ca5a5ff-e084-46ed-85d8-342444023079", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50052025-04-30T06:29:51.155ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
50062025-04-30T06:29:51.157ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49b9c04e-8e16-45e4-9765-8edfdaf2ab59", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50072025-04-30T06:29:51.157ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
50082025-04-30T06:29:51.158ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "47ee437b-298c-4bf3-a421-29db31a74425", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50092025-04-30T06:29:51.158ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
50102025-04-30T06:29:51.159ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "85be72dd-edb2-45ba-ae55-3542586b90d8", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50112025-04-30T06:29:51.159ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
50122025-04-30T06:29:51.162ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dfb9cd6-7d53-4919-a803-bee59ca8d00e", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50132025-04-30T06:29:51.163ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
50142025-04-30T06:29:51.171ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
50152025-04-30T06:29:51.171ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50162025-04-30T06:29:51.171ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
50172025-04-30T06:29:51.171ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
50182025-04-30T06:29:51.191ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
50192025-04-30T06:29:51.200ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50202025-04-30T06:29:51.207ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
50212025-04-30T06:29:51.207ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
50222025-04-30T06:29:51.208ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
50232025-04-30T06:29:51.208ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
50242025-04-30T06:29:51.231ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
50252025-04-30T06:29:51.231ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
50262025-04-30T06:29:51.232ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
50272025-04-30T06:29:51.257ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8bd6b08-8e05-4f2b-84fe-d5c11d77da32", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50282025-04-30T06:29:51.257ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
50292025-04-30T06:29:51.270ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c0f0f98-a486-4676-b6f7-8da9b51b5ddc", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50302025-04-30T06:29:51.270ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
50312025-04-30T06:29:51.273ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fb9f107-10ad-4714-910f-6a2e8da3ca1b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50322025-04-30T06:29:51.273ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
50332025-04-30T06:29:51.275ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2c7895c-8901-4685-a859-86d68500a752", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50342025-04-30T06:29:51.275ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
50352025-04-30T06:29:51.277ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d29169e-46df-4064-9d04-82da603dcea8", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50362025-04-30T06:29:51.277ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
50372025-04-30T06:29:51.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e987e1fe-e1f6-4f09-84d6-8ecd75162204", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50382025-04-30T06:29:51.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
50392025-04-30T06:29:51.280ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a45ed59f-cea3-4e16-a417-65a09cafd58a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50402025-04-30T06:29:51.280ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
50412025-04-30T06:29:51.281ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "22909135-3428-4def-8ab4-3256515386c1", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50422025-04-30T06:29:51.281ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
50432025-04-30T06:29:51.282ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e2e1b73-510a-4502-b66b-deb34f5e2d65", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50442025-04-30T06:29:51.282ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
50452025-04-30T06:29:51.284ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e6f47db-b568-4e9b-95de-f15337554c05", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50462025-04-30T06:29:51.284ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
50472025-04-30T06:29:51.287ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ffc7d38-ca5d-41ed-9ab3-17707a88fb3e", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50482025-04-30T06:29:51.287ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
50492025-04-30T06:29:51.290ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d009327e-5bed-48d2-b5b2-2bde35d8b326", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50502025-04-30T06:29:51.291ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
50512025-04-30T06:29:51.295ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed9762d-9c81-4038-b0a3-5355fb3b842b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50522025-04-30T06:29:51.295ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
50532025-04-30T06:29:51.295ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a51ea001-0d28-4e7b-a092-47adc2ecdd88", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50542025-04-30T06:29:51.295ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
50552025-04-30T06:29:51.298ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c39a371e-e67b-48e5-80ec-2014b00eb8ed", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50562025-04-30T06:29:51.298ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
50572025-04-30T06:29:51.325ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
50582025-04-30T06:29:51.364ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
50592025-04-30T06:29:51.367ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
50602025-04-30T06:29:51.368ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3dab461e-71e8-4c38-a59e-acb43b5a3ee8 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
50612025-04-30T06:29:51.368ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3dab461e-71e8-4c38-a59e-acb43b5a3ee8 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
50622025-04-30T06:29:51.368ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3dab461e-71e8-4c38-a59e-acb43b5a3ee8 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
50632025-04-30T06:29:51.369ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3dab461e-71e8-4c38-a59e-acb43b5a3ee8 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
50642025-04-30T06:29:51.371ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "53656432-a5b5-4fb2-b3e3-a7361ddefb82", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50652025-04-30T06:29:51.372ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
50662025-04-30T06:29:51.374ZINFOtest_image_create (dropshot_internal): request completed latency_us = 5847 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3dab461e-71e8-4c38-a59e-acb43b5a3ee8 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
50672025-04-30T06:29:51.376ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dab461e-71e8-4c38-a59e-acb43b5a3ee8", "content-length": "405", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50682025-04-30T06:29:51.376ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
50692025-04-30T06:29:51.376ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "35ccbdd2-04ee-4bab-b9f6-6d483fcc1d66", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50702025-04-30T06:29:51.383ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
50712025-04-30T06:29:51.384ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb5d261-543e-49fc-a514-3424f7131fba uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
50722025-04-30T06:29:51.384ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb5d261-543e-49fc-a514-3424f7131fba resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
50732025-04-30T06:29:51.384ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb5d261-543e-49fc-a514-3424f7131fba roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
50742025-04-30T06:29:51.386ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb5d261-543e-49fc-a514-3424f7131fba resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
50752025-04-30T06:29:51.388ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d338c645-42f1-4720-ab74-38d119867763", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50762025-04-30T06:29:51.388ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
50772025-04-30T06:29:51.392ZINFOtest_image_create (dropshot_internal): request completed latency_us = 8089 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb5d261-543e-49fc-a514-3424f7131fba response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
50782025-04-30T06:29:51.394ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb5d261-543e-49fc-a514-3424f7131fba", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50792025-04-30T06:29:51.394ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
50802025-04-30T06:29:51.394ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
50812025-04-30T06:29:51.394ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
50822025-04-30T06:29:51.394ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8431106-2c5f-4488-8e2c-06a0f9fb31d9", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50832025-04-30T06:29:51.396ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
50842025-04-30T06:29:51.410ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "85e0e5bd-b590-43dc-8937-27d5d581fe0d", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
50852025-04-30T06:29:51.444ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
50862025-04-30T06:29:51.473ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
50872025-04-30T06:29:51.474ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50882025-04-30T06:29:51.474ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
50892025-04-30T06:29:51.474ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
50902025-04-30T06:29:51.475ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
50912025-04-30T06:29:51.478ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
50922025-04-30T06:29:51.480ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
50932025-04-30T06:29:51.483ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
50942025-04-30T06:29:51.484ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
50952025-04-30T06:29:51.484ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
50962025-04-30T06:29:51.484ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
50972025-04-30T06:29:51.484ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50982025-04-30T06:29:51.490ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
50992025-04-30T06:29:51.490ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51002025-04-30T06:29:51.490ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51012025-04-30T06:29:51.490ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51022025-04-30T06:29:51.513ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51032025-04-30T06:29:51.513ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51042025-04-30T06:29:51.513ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51052025-04-30T06:29:51.521ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97b0d3f9-0370-4bd4-a4fa-31b5146b478b", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51062025-04-30T06:29:51.521ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
51072025-04-30T06:29:51.522ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
51082025-04-30T06:29:51.522ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
51092025-04-30T06:29:51.527ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
51102025-04-30T06:29:51.528ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
51112025-04-30T06:29:51.536ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
51122025-04-30T06:29:51.536ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
51132025-04-30T06:29:51.540ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
51142025-04-30T06:29:51.540ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
51152025-04-30T06:29:51.572ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0076f638-6a1c-41ab-958d-1c9fa6d76f7b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51162025-04-30T06:29:51.608ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
51172025-04-30T06:29:51.625ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4754a116-1f8d-4d72-a1ad-0275b953fea7", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51182025-04-30T06:29:51.625ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
51192025-04-30T06:29:51.627ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
51202025-04-30T06:29:51.628ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6600e64-d82c-4cd7-9a26-81a67567ed75", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51212025-04-30T06:29:51.628ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
51222025-04-30T06:29:51.637ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f6b6159-6d6b-4c07-a2e4-7626fc39d868", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51232025-04-30T06:29:51.638ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
51242025-04-30T06:29:51.638ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
51252025-04-30T06:29:51.658ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "426cd7b0-2270-4bfc-b520-99ae9c263fa4", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51262025-04-30T06:29:51.658ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
51272025-04-30T06:29:51.696ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
51282025-04-30T06:29:51.697ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51292025-04-30T06:29:51.699ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51302025-04-30T06:29:51.702ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51312025-04-30T06:29:51.703ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51322025-04-30T06:29:51.704ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc918812-9e2a-4cbb-b929-ea01cf6e18f5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51332025-04-30T06:29:51.704ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
51342025-04-30T06:29:51.707ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51352025-04-30T06:29:51.735ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
51362025-04-30T06:29:51.740ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51372025-04-30T06:29:51.740ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51382025-04-30T06:29:51.744ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51392025-04-30T06:29:51.754ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "209b13da-e4d7-475a-a827-b98319f3beb8", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51402025-04-30T06:29:51.754ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
51412025-04-30T06:29:51.759ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51422025-04-30T06:29:51.760ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51432025-04-30T06:29:51.784ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51442025-04-30T06:29:51.785ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b35f5f8-3aa4-4ebb-a98e-65cc04041756", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51452025-04-30T06:29:51.785ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
51462025-04-30T06:29:51.799ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "34044a2c-7b5b-4a6b-af29-0df06d04c19d", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51472025-04-30T06:29:51.802ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
51482025-04-30T06:29:51.830ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ebe7bd2-d7ac-4fff-b505-cb6326dc1b4e", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51492025-04-30T06:29:51.831ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
51502025-04-30T06:29:51.869ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51512025-04-30T06:29:51.869ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
51522025-04-30T06:29:51.869ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51532025-04-30T06:29:51.869ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51542025-04-30T06:29:51.875ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51552025-04-30T06:29:51.879ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
51562025-04-30T06:29:51.879ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
51572025-04-30T06:29:51.879ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51582025-04-30T06:29:51.879ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
51592025-04-30T06:29:51.879ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51602025-04-30T06:29:51.880ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51612025-04-30T06:29:51.909ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51622025-04-30T06:29:51.913ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
51632025-04-30T06:29:51.913ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
51642025-04-30T06:29:51.913ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51652025-04-30T06:29:51.914ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51662025-04-30T06:29:52.084ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
51672025-04-30T06:29:52.084ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
51682025-04-30T06:29:52.085ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:63721 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
51692025-04-30T06:29:52.086ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:63721 req_id = 3d14b69b-b27a-407b-80ee-4472c637383a sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
51702025-04-30T06:29:52.087ZINFOtest_image_create (dropshot): request completed latency_us = 1419 local_addr = [::1]:42828 method = GET remote_addr = [::1]:63721 req_id = 3d14b69b-b27a-407b-80ee-4472c637383a response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
51712025-04-30T06:29:52.101ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d14b69b-b27a-407b-80ee-4472c637383a", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:51 GMT"} })
51722025-04-30T06:29:52.104ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
51732025-04-30T06:29:52.104ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
51742025-04-30T06:29:52.104ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
51752025-04-30T06:29:52.106ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
51762025-04-30T06:29:52.106ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51772025-04-30T06:29:52.106ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
51782025-04-30T06:29:52.106ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51792025-04-30T06:29:52.107ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51802025-04-30T06:29:52.122ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51812025-04-30T06:29:52.127ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
51822025-04-30T06:29:52.135ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
51832025-04-30T06:29:52.139ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51842025-04-30T06:29:52.142ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51852025-04-30T06:29:52.143ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
51862025-04-30T06:29:52.197ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
51872025-04-30T06:29:52.197ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51882025-04-30T06:29:52.197ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51892025-04-30T06:29:52.197ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51902025-04-30T06:29:52.197ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51912025-04-30T06:29:52.201ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51922025-04-30T06:29:52.206ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
51932025-04-30T06:29:52.206ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51942025-04-30T06:29:52.206ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51952025-04-30T06:29:52.207ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51962025-04-30T06:29:52.255ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
51972025-04-30T06:29:52.255ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
51982025-04-30T06:29:52.256ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
51992025-04-30T06:29:52.256ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
52002025-04-30T06:29:52.256ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
52012025-04-30T06:29:52.256ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.289157854s iteration = 12 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
52022025-04-30T06:29:52.256ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 13 reason = Signaled
52032025-04-30T06:29:52.256ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
52042025-04-30T06:29:52.256ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52052025-04-30T06:29:52.256ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
52062025-04-30T06:29:52.256ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52072025-04-30T06:29:52.257ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
52082025-04-30T06:29:52.272ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52092025-04-30T06:29:52.294ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
52102025-04-30T06:29:52.294ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
52112025-04-30T06:29:52.294ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52122025-04-30T06:29:52.294ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
52132025-04-30T06:29:52.322ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
52142025-04-30T06:29:52.322ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
52152025-04-30T06:29:52.326ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: c1 1b 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:51591 req_id = b0fe7964-e78f-47ae-a772-49c83b7bfb9c
52162025-04-30T06:29:52.326ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49435,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51591 req_id = b0fe7964-e78f-47ae-a772-49c83b7bfb9c
52172025-04-30T06:29:52.326ZDEBGtest_image_create (store): query key key = _mgs._tcp
52182025-04-30T06:29:52.327ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
52192025-04-30T06:29:52.328ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:51591 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = b0fe7964-e78f-47ae-a772-49c83b7bfb9c
52202025-04-30T06:29:52.332ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3457, tv_nsec: 131314088 } })
52212025-04-30T06:29:52.332ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
52222025-04-30T06:29:52.344ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 36 57 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e 6W..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:57247 req_id = 84886202-6a62-4eb0-a2e3-65e1b4eef1e7
52232025-04-30T06:29:52.344ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 13911,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57247 req_id = 84886202-6a62-4eb0-a2e3-65e1b4eef1e7
52242025-04-30T06:29:52.344ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
52252025-04-30T06:29:52.345ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:57247 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 84886202-6a62-4eb0-a2e3-65e1b4eef1e7
52262025-04-30T06:29:52.429ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
52272025-04-30T06:29:52.429ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
52282025-04-30T06:29:52.430ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
52292025-04-30T06:29:52.431ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: b3 25 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .%..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:59158 req_id = 7518e07b-7fcc-4df6-a6cd-b9905570a46b
52302025-04-30T06:29:52.431ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45861,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59158 req_id = 7518e07b-7fcc-4df6-a6cd-b9905570a46b
52312025-04-30T06:29:52.432ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
52322025-04-30T06:29:52.432ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45861, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59158 req_id = 7518e07b-7fcc-4df6-a6cd-b9905570a46b
52332025-04-30T06:29:52.433ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
52342025-04-30T06:29:52.433ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
52352025-04-30T06:29:52.433ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
52362025-04-30T06:29:52.434ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
52372025-04-30T06:29:52.434ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
52382025-04-30T06:29:52.435ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
52392025-04-30T06:29:52.435ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
52402025-04-30T06:29:52.443ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e95a2cb-c478-48b3-abbf-e4fb64f1783e", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52412025-04-30T06:29:52.444ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
52422025-04-30T06:29:52.447ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f06358-c607-4369-925e-0d610fd319c5", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52432025-04-30T06:29:52.447ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
52442025-04-30T06:29:52.450ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d2a434e-9d1d-498d-a70f-8c07d580afd3", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52452025-04-30T06:29:52.451ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
52462025-04-30T06:29:52.454ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8da1dde2-ca09-4a1d-b154-75f116b41a7a", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52472025-04-30T06:29:52.454ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
52482025-04-30T06:29:52.455ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
52492025-04-30T06:29:52.459ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7d8ab29-2d29-4edf-81f0-a05a9dcb5603", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52502025-04-30T06:29:52.459ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
52512025-04-30T06:29:52.461ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "686dc52c-e907-436c-bc9b-455ae8cd650e", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52522025-04-30T06:29:52.461ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
52532025-04-30T06:29:52.462ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ebb336b-1596-435b-bb89-82972e296217", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52542025-04-30T06:29:52.463ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
52552025-04-30T06:29:52.465ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5eed7a8-3d42-444b-8234-b425202889fa", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52562025-04-30T06:29:52.465ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
52572025-04-30T06:29:52.466ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4efa955d-bb90-4205-bbc2-455f0e505908", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52582025-04-30T06:29:52.466ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
52592025-04-30T06:29:52.467ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c1de0f9-38d8-41c9-9e5f-3534322d7d23", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52602025-04-30T06:29:52.467ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
52612025-04-30T06:29:52.468ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f6a48fb-142e-465e-910a-d1ee11d9a9a5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52622025-04-30T06:29:52.468ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
52632025-04-30T06:29:52.469ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3d99dac-21ac-4062-9a69-ead92c9ca69f", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52642025-04-30T06:29:52.469ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
52652025-04-30T06:29:52.470ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "161ca0d2-aed4-4dbc-bcad-644ba7196f19", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52662025-04-30T06:29:52.470ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
52672025-04-30T06:29:52.472ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "67bd3fcf-48bf-4752-bbe6-4bbe1eef3828", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52682025-04-30T06:29:52.472ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
52692025-04-30T06:29:52.474ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7875f454-10f2-401e-9a5a-4937e929137f", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52702025-04-30T06:29:52.474ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
52712025-04-30T06:29:52.495ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e1c951-20b9-422b-9fc2-22bf637763d0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52722025-04-30T06:29:52.496ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
52732025-04-30T06:29:52.518ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
52742025-04-30T06:29:52.548ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52752025-04-30T06:29:52.548ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
52762025-04-30T06:29:52.548ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
52772025-04-30T06:29:52.550ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
52782025-04-30T06:29:52.562ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52792025-04-30T06:29:52.562ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52802025-04-30T06:29:52.563ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
52812025-04-30T06:29:52.563ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
52822025-04-30T06:29:52.572ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52832025-04-30T06:29:52.589ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
52842025-04-30T06:29:52.589ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
52852025-04-30T06:29:52.589ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
52862025-04-30T06:29:52.590ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
52872025-04-30T06:29:52.643ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
52882025-04-30T06:29:52.643ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
52892025-04-30T06:29:52.644ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2010f501-52ef-4892-8615-826cbf4c2288", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52902025-04-30T06:29:52.645ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
52912025-04-30T06:29:52.645ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
52922025-04-30T06:29:52.645ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
52932025-04-30T06:29:52.646ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
52942025-04-30T06:29:52.651ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7e5bc45-71a4-42a9-8bc5-14534548ab4c", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52952025-04-30T06:29:52.651ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
52962025-04-30T06:29:52.651ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
52972025-04-30T06:29:52.651ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52982025-04-30T06:29:52.654ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f724c22-8f95-42bc-a4ad-4ca39bdc19b1", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
52992025-04-30T06:29:52.654ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
53002025-04-30T06:29:52.656ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "92d44902-6e72-41fb-be46-1198883f1ac4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53012025-04-30T06:29:52.656ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
53022025-04-30T06:29:52.688ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
53032025-04-30T06:29:52.703ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "500b728e-b63b-42d7-ab40-54df8782db48", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53042025-04-30T06:29:52.703ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
53052025-04-30T06:29:52.717ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eaa5b11-139a-499f-ab4a-e8118aa20da7", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53062025-04-30T06:29:52.718ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
53072025-04-30T06:29:52.721ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ed4f43f-a8d2-452c-8c62-75dd62e80794", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53082025-04-30T06:29:52.721ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
53092025-04-30T06:29:52.738ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7a50030-70a4-40af-ae2a-36da810a4856", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53102025-04-30T06:29:52.738ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
53112025-04-30T06:29:52.742ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0eebdae2-bb0d-4bb9-b7ce-c83f9f2f7b04", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53122025-04-30T06:29:52.742ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
53132025-04-30T06:29:52.778ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
53142025-04-30T06:29:52.812ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "65da61ef-7315-4bc5-8e6a-16e4f56a76df", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53152025-04-30T06:29:52.812ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
53162025-04-30T06:29:52.821ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "40be0a91-bd83-4c23-bb91-a81074d3484a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53172025-04-30T06:29:52.821ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
53182025-04-30T06:29:52.823ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfe8aa6b-4f1d-470f-bf56-14d1c8c9ed8d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53192025-04-30T06:29:52.823ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
53202025-04-30T06:29:52.825ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c97fe319-a674-40a8-9658-ee74d63a5417", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53212025-04-30T06:29:52.849ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
53222025-04-30T06:29:52.849ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
53232025-04-30T06:29:52.849ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53242025-04-30T06:29:52.849ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
53252025-04-30T06:29:52.849ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
53262025-04-30T06:29:52.850ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
53272025-04-30T06:29:52.854ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53282025-04-30T06:29:52.860ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
53292025-04-30T06:29:52.860ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
53302025-04-30T06:29:52.860ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
53312025-04-30T06:29:52.861ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
53322025-04-30T06:29:52.861ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d80ad8e-49a5-4ee5-bfb8-40d295ce7f3c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53332025-04-30T06:29:52.862ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
53342025-04-30T06:29:52.865ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff9d1f8f-7ab8-4003-bf3b-0ecaec08609b", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53352025-04-30T06:29:52.872ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
53362025-04-30T06:29:52.874ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
53372025-04-30T06:29:52.874ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
53382025-04-30T06:29:52.892ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
53392025-04-30T06:29:52.912ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "06216298-2568-489a-886b-55f453f0fa15", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53402025-04-30T06:29:52.912ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
53412025-04-30T06:29:52.914ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9c73421-d7ec-403d-b831-4306bc6781a3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53422025-04-30T06:29:52.914ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
53432025-04-30T06:29:52.915ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe32eda6-1058-459f-9954-6505ee83f1e5", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53442025-04-30T06:29:52.915ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
53452025-04-30T06:29:52.917ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "11c7064d-d26c-42ba-8e65-28914ace8270", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53462025-04-30T06:29:52.928ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
53472025-04-30T06:29:52.953ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e03ded8e-f1f0-499c-85a2-9e149ceab192", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53482025-04-30T06:29:52.953ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
53492025-04-30T06:29:52.967ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d58b6485-8f96-4000-ab30-cf0371af44a5", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53502025-04-30T06:29:52.968ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
53512025-04-30T06:29:52.970ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "58d7e76f-e202-41e0-b15a-b80d0efb5bc1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53522025-04-30T06:29:52.970ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
53532025-04-30T06:29:52.972ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "44456e7c-48e6-4444-a4ed-d4ee50b12574", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53542025-04-30T06:29:52.972ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
53552025-04-30T06:29:52.974ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "53ccd775-fed6-4633-a1a1-c2b677307846", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53562025-04-30T06:29:52.974ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
53572025-04-30T06:29:52.982ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af27d334-a3bc-4520-9ae7-d585400a50dd", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53582025-04-30T06:29:52.982ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
53592025-04-30T06:29:52.984ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d61f9e67-8b6b-439d-b9e4-1639d3e95cb0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53602025-04-30T06:29:52.984ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
53612025-04-30T06:29:52.986ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "71d2c151-eb8e-4f5e-bbec-6df2bc796618", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53622025-04-30T06:29:52.986ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
53632025-04-30T06:29:52.987ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
53642025-04-30T06:29:52.990ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "74e89e20-2ab8-41b4-87ff-10fdcfaa8bdb", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53652025-04-30T06:29:52.990ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
53662025-04-30T06:29:52.991ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f1a59d7-e9bb-46be-8e5a-a6e6746db328", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:52 GMT"} })
53672025-04-30T06:29:52.992ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
53682025-04-30T06:29:52.992ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53692025-04-30T06:29:52.992ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
53702025-04-30T06:29:52.992ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53712025-04-30T06:29:52.993ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53722025-04-30T06:29:53.006ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53732025-04-30T06:29:53.010ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
53742025-04-30T06:29:53.010ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
53752025-04-30T06:29:53.010ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53762025-04-30T06:29:53.010ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
53772025-04-30T06:29:53.011ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53782025-04-30T06:29:53.012ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53792025-04-30T06:29:53.048ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
53802025-04-30T06:29:53.048ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53812025-04-30T06:29:53.048ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
53822025-04-30T06:29:53.048ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
53832025-04-30T06:29:53.049ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
53842025-04-30T06:29:53.063ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852025-04-30T06:29:53.069ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
53862025-04-30T06:29:53.069ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
53872025-04-30T06:29:53.069ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53882025-04-30T06:29:53.070ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53892025-04-30T06:29:53.077ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53902025-04-30T06:29:53.085ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
53912025-04-30T06:29:53.085ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
53922025-04-30T06:29:53.085ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
53932025-04-30T06:29:53.086ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
53942025-04-30T06:29:53.203ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
53952025-04-30T06:29:53.203ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
53962025-04-30T06:29:53.205ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:35484 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
53972025-04-30T06:29:53.205ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
53982025-04-30T06:29:53.206ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
53992025-04-30T06:29:53.207ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
54002025-04-30T06:29:53.207ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:35484 req_id = d25dda40-a428-4b1a-8e04-36d18f0399ae sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
54012025-04-30T06:29:53.208ZINFOtest_image_create (dropshot): request completed latency_us = 1567 local_addr = [::1]:42828 method = GET remote_addr = [::1]:35484 req_id = d25dda40-a428-4b1a-8e04-36d18f0399ae response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
54022025-04-30T06:29:53.209ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "d25dda40-a428-4b1a-8e04-36d18f0399ae", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54032025-04-30T06:29:53.211ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
54042025-04-30T06:29:53.211ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
54052025-04-30T06:29:53.211ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
54062025-04-30T06:29:53.214ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
54072025-04-30T06:29:53.214ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54082025-04-30T06:29:53.214ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
54092025-04-30T06:29:53.214ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54102025-04-30T06:29:53.214ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54112025-04-30T06:29:53.222ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54122025-04-30T06:29:53.227ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
54132025-04-30T06:29:53.227ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
54142025-04-30T06:29:53.227ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54152025-04-30T06:29:53.227ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54162025-04-30T06:29:53.289ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
54172025-04-30T06:29:53.303ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
54182025-04-30T06:29:53.303ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
54192025-04-30T06:29:53.303ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.046752125s iteration = 13 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
54202025-04-30T06:29:53.303ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 14 reason = Signaled
54212025-04-30T06:29:53.303ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
54222025-04-30T06:29:53.303ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54232025-04-30T06:29:53.303ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
54242025-04-30T06:29:53.303ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54252025-04-30T06:29:53.304ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54262025-04-30T06:29:53.310ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
54272025-04-30T06:29:53.310ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
54282025-04-30T06:29:53.312ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 357edc5b-e12a-4c27-861f-dc83238b20a0 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
54292025-04-30T06:29:53.312ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 357edc5b-e12a-4c27-861f-dc83238b20a0 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
54302025-04-30T06:29:53.312ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 357edc5b-e12a-4c27-861f-dc83238b20a0 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
54312025-04-30T06:29:53.313ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 357edc5b-e12a-4c27-861f-dc83238b20a0 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
54322025-04-30T06:29:53.313ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54332025-04-30T06:29:53.319ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
54342025-04-30T06:29:53.319ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
54352025-04-30T06:29:53.319ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54362025-04-30T06:29:53.322ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54372025-04-30T06:29:53.325ZINFOtest_image_create (dropshot_internal): request completed latency_us = 13277 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 357edc5b-e12a-4c27-861f-dc83238b20a0 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
54382025-04-30T06:29:53.326ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "357edc5b-e12a-4c27-861f-dc83238b20a0", "content-length": "405", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54392025-04-30T06:29:53.326ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
54402025-04-30T06:29:53.327ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
54412025-04-30T06:29:53.327ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
54422025-04-30T06:29:53.328ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = ca8d5276-0904-457a-b72f-554d3375eeae uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
54432025-04-30T06:29:53.328ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = ca8d5276-0904-457a-b72f-554d3375eeae resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
54442025-04-30T06:29:53.328ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = ca8d5276-0904-457a-b72f-554d3375eeae roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
54452025-04-30T06:29:53.329ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = ca8d5276-0904-457a-b72f-554d3375eeae resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
54462025-04-30T06:29:53.329ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 11 67 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .g..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:57554 req_id = 3930cab7-10ef-4203-a839-2076bae7dd8f
54472025-04-30T06:29:53.329ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 4455,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57554 req_id = 3930cab7-10ef-4203-a839-2076bae7dd8f
54482025-04-30T06:29:53.329ZDEBGtest_image_create (store): query key key = _mgs._tcp
54492025-04-30T06:29:53.330ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
54502025-04-30T06:29:53.330ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:57554 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 3930cab7-10ef-4203-a839-2076bae7dd8f
54512025-04-30T06:29:53.330ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3458, tv_nsec: 129448485 } })
54522025-04-30T06:29:53.330ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
54532025-04-30T06:29:53.332ZINFOtest_image_create (dropshot_internal): request completed latency_us = 4404 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = ca8d5276-0904-457a-b72f-554d3375eeae response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
54542025-04-30T06:29:53.332ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 9a 48 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .H..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:57432 req_id = c538fcc4-29ac-4c69-afd1-4b1b54b5d732
54552025-04-30T06:29:53.333ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 39496,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57432 req_id = c538fcc4-29ac-4c69-afd1-4b1b54b5d732
54562025-04-30T06:29:53.333ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
54572025-04-30T06:29:53.333ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:57432 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = c538fcc4-29ac-4c69-afd1-4b1b54b5d732
54582025-04-30T06:29:53.333ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca8d5276-0904-457a-b72f-554d3375eeae", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54592025-04-30T06:29:53.333ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
54602025-04-30T06:29:53.333ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
54612025-04-30T06:29:53.333ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
54622025-04-30T06:29:53.392ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
54632025-04-30T06:29:53.392ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
54642025-04-30T06:29:53.392ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54652025-04-30T06:29:53.392ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
54662025-04-30T06:29:53.392ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
54672025-04-30T06:29:53.393ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
54682025-04-30T06:29:53.395ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: b2 a5 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:62526 req_id = d29548a7-91ab-4705-a0d0-f5b24a65a60a
54692025-04-30T06:29:53.395ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45733,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62526 req_id = d29548a7-91ab-4705-a0d0-f5b24a65a60a
54702025-04-30T06:29:53.395ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
54712025-04-30T06:29:53.396ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45733, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:62526 req_id = d29548a7-91ab-4705-a0d0-f5b24a65a60a
54722025-04-30T06:29:53.396ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
54732025-04-30T06:29:53.396ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
54742025-04-30T06:29:53.396ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
54752025-04-30T06:29:53.397ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54762025-04-30T06:29:53.403ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
54772025-04-30T06:29:53.403ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
54782025-04-30T06:29:53.403ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
54792025-04-30T06:29:53.404ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
54802025-04-30T06:29:53.408ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
54812025-04-30T06:29:53.408ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
54822025-04-30T06:29:53.409ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
54832025-04-30T06:29:53.409ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e9c89b1-dabf-40c8-af1a-650581c3b5ee", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54842025-04-30T06:29:53.409ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
54852025-04-30T06:29:53.411ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "223f4575-5cde-4ee5-ba04-cf1989215006", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54862025-04-30T06:29:53.412ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
54872025-04-30T06:29:53.417ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "19b666dc-15fa-4150-9559-9fb0fc741a6b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54882025-04-30T06:29:53.417ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
54892025-04-30T06:29:53.419ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
54902025-04-30T06:29:53.419ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
54912025-04-30T06:29:53.421ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
54922025-04-30T06:29:53.422ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
54932025-04-30T06:29:53.422ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
54942025-04-30T06:29:53.422ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
54952025-04-30T06:29:53.423ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "85914d92-bd6b-4783-beef-415f4bd58814", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54962025-04-30T06:29:53.424ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
54972025-04-30T06:29:53.426ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "af459688-c4d1-4d61-b325-0701d4c6a20d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
54982025-04-30T06:29:53.426ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
54992025-04-30T06:29:53.429ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f318143e-db54-484b-b4ce-3d57cc8bc492", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55002025-04-30T06:29:53.429ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
55012025-04-30T06:29:53.432ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd5248bb-0b52-4c01-82a5-3b5b7d4fd902", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55022025-04-30T06:29:53.432ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
55032025-04-30T06:29:53.436ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b9ec718-df3e-4e2e-a255-d98c6815f602", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55042025-04-30T06:29:53.436ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
55052025-04-30T06:29:53.438ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "311edf7b-585e-417e-a852-9f0cb931801a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55062025-04-30T06:29:53.439ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
55072025-04-30T06:29:53.439ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
55082025-04-30T06:29:53.441ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "300e1285-3d73-41fe-b44e-1b0487bbc4c0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55092025-04-30T06:29:53.441ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
55102025-04-30T06:29:53.442ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "de117aa8-57fb-4968-ac94-4f36937ea782", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55112025-04-30T06:29:53.442ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
55122025-04-30T06:29:53.443ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a07d957a-b7e7-4080-b496-07c3f2384500", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55132025-04-30T06:29:53.443ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
55142025-04-30T06:29:53.445ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "51fc7247-7aa7-44f5-8d5c-721997df1e27", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55152025-04-30T06:29:53.445ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
55162025-04-30T06:29:53.447ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1882dc4f-d617-43d2-95eb-070061154014", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55172025-04-30T06:29:53.447ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
55182025-04-30T06:29:53.449ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a624135a-d188-474e-801e-5bb75511cf42", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55192025-04-30T06:29:53.449ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
55202025-04-30T06:29:53.451ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5575e83c-9145-4c43-95d6-90b365ca3327", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55212025-04-30T06:29:53.451ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
55222025-04-30T06:29:53.453ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "031370e8-cce6-4495-a958-7e54e247025c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55232025-04-30T06:29:53.454ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
55242025-04-30T06:29:53.456ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "010ea231-e258-405b-8fa7-befc3ae9a759", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55252025-04-30T06:29:53.457ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
55262025-04-30T06:29:53.459ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5831c04c-cc3d-494f-a69b-23122cbe8389", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55272025-04-30T06:29:53.459ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
55282025-04-30T06:29:53.461ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0e150de-cac4-4093-b12a-aa51cb39fe6e", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55292025-04-30T06:29:53.461ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
55302025-04-30T06:29:53.464ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a354ad4f-8852-4683-9e39-3b2fc55ff9db", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55312025-04-30T06:29:53.464ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
55322025-04-30T06:29:53.465ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbd08916-06d6-4d7b-8df8-61da54ba3da9", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55332025-04-30T06:29:53.466ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
55342025-04-30T06:29:53.467ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb3baa04-d8df-4186-93b2-c7b12d76e05a", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55352025-04-30T06:29:53.468ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
55362025-04-30T06:29:53.470ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c877a3c-25c8-4e56-8f47-3221d52e3666", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55372025-04-30T06:29:53.470ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
55382025-04-30T06:29:53.473ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdabe3be-198b-4492-b844-460be79f37f7", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55392025-04-30T06:29:53.473ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
55402025-04-30T06:29:53.476ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "04ec3f1a-9d91-434c-8bed-67e8d7018f82", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55412025-04-30T06:29:53.476ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
55422025-04-30T06:29:53.478ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "acc082bb-d9ff-448e-8e56-92a1f9e11365", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55432025-04-30T06:29:53.479ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
55442025-04-30T06:29:53.484ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1f8af61-d705-4ea3-9e8f-87428db3a81e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55452025-04-30T06:29:53.484ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
55462025-04-30T06:29:53.494ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
55472025-04-30T06:29:53.494ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55482025-04-30T06:29:53.494ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
55492025-04-30T06:29:53.494ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
55502025-04-30T06:29:53.495ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
55512025-04-30T06:29:53.510ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55522025-04-30T06:29:53.516ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
55532025-04-30T06:29:53.516ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
55542025-04-30T06:29:53.516ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
55552025-04-30T06:29:53.516ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
55562025-04-30T06:29:53.517ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55572025-04-30T06:29:53.517ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55582025-04-30T06:29:53.518ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
55592025-04-30T06:29:53.519ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
55602025-04-30T06:29:53.521ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
55612025-04-30T06:29:53.521ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
55622025-04-30T06:29:53.522ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
55632025-04-30T06:29:53.534ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
55642025-04-30T06:29:53.534ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
55652025-04-30T06:29:53.539ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
55662025-04-30T06:29:53.539ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55672025-04-30T06:29:53.549ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eccb7dad-f86c-440e-a800-0d3bedbe7c3d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55682025-04-30T06:29:53.549ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
55692025-04-30T06:29:53.568ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2d35137-fbcf-4952-90e8-e51422b6d4e8", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55702025-04-30T06:29:53.569ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
55712025-04-30T06:29:53.571ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc2ecb91-2c7b-433a-8b0c-f081f452c6a0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55722025-04-30T06:29:53.571ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
55732025-04-30T06:29:53.571ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c96ff433-6da8-43a9-96d3-26bb01b8ccf8", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55742025-04-30T06:29:53.571ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
55752025-04-30T06:29:53.578ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f56336d5-244d-47cf-b3ff-91f633e9d9c5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55762025-04-30T06:29:53.578ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
55772025-04-30T06:29:53.586ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c4677fe-1291-439c-a24e-c2237fb6f027", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55782025-04-30T06:29:53.591ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
55792025-04-30T06:29:53.594ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
55802025-04-30T06:29:53.597ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d100a4ec-5257-4537-a4e5-9e9dae4f1ada", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55812025-04-30T06:29:53.597ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
55822025-04-30T06:29:53.599ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "28470737-49e7-43f5-8082-6eb248d9a370", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55832025-04-30T06:29:53.599ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
55842025-04-30T06:29:53.604ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ab6bf5a-17ff-4cd0-aa5e-893fed95e794", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55852025-04-30T06:29:53.604ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
55862025-04-30T06:29:53.607ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b592df37-c421-40de-bc39-31828002898c", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55872025-04-30T06:29:53.607ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
55882025-04-30T06:29:53.609ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "91e08e3d-fb3b-43ab-b192-9587a3edcb86", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55892025-04-30T06:29:53.609ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
55902025-04-30T06:29:53.611ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5efbe784-d260-4d89-a00f-2de4cc45e78c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55912025-04-30T06:29:53.612ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
55922025-04-30T06:29:53.614ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea366ec5-1dd4-4770-abe1-dc7fe7a780af", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55932025-04-30T06:29:53.614ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
55942025-04-30T06:29:53.615ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24bf98cb-0965-4fef-a9b0-b4092a41606c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55952025-04-30T06:29:53.615ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
55962025-04-30T06:29:53.617ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ad6544c-8131-4f55-b94b-8dfa90e4b86c", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55972025-04-30T06:29:53.617ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
55982025-04-30T06:29:53.619ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54fdfbb0-2e34-4afc-8612-412c7597bc48", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
55992025-04-30T06:29:53.619ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
56002025-04-30T06:29:53.619ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
56012025-04-30T06:29:53.620ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa42704f-2e08-40a9-bc62-ff4447503370", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
56022025-04-30T06:29:53.620ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
56032025-04-30T06:29:53.621ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56042025-04-30T06:29:53.621ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
56052025-04-30T06:29:53.621ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56062025-04-30T06:29:53.622ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56072025-04-30T06:29:53.648ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
56082025-04-30T06:29:53.648ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56092025-04-30T06:29:53.648ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
56102025-04-30T06:29:53.648ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
56112025-04-30T06:29:53.649ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
56122025-04-30T06:29:53.649ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56132025-04-30T06:29:53.652ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
56142025-04-30T06:29:53.652ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
56152025-04-30T06:29:53.652ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56162025-04-30T06:29:53.653ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
56172025-04-30T06:29:53.653ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56182025-04-30T06:29:53.653ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56192025-04-30T06:29:53.657ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56202025-04-30T06:29:53.662ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
56212025-04-30T06:29:53.662ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
56222025-04-30T06:29:53.662ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
56232025-04-30T06:29:53.663ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
56242025-04-30T06:29:53.663ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56252025-04-30T06:29:53.671ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
56262025-04-30T06:29:53.672ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
56272025-04-30T06:29:53.672ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56282025-04-30T06:29:53.673ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56292025-04-30T06:29:53.685ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
56302025-04-30T06:29:53.685ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
56312025-04-30T06:29:53.685ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
56322025-04-30T06:29:53.760ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
56332025-04-30T06:29:53.760ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
56342025-04-30T06:29:53.761ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:46600 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
56352025-04-30T06:29:53.761ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:46600 req_id = 4e61c440-e8e4-48a9-97d4-42c0a1f061f0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
56362025-04-30T06:29:53.762ZINFOtest_image_create (dropshot): request completed latency_us = 434 local_addr = [::1]:42828 method = GET remote_addr = [::1]:46600 req_id = 4e61c440-e8e4-48a9-97d4-42c0a1f061f0 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
56372025-04-30T06:29:53.762ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e61c440-e8e4-48a9-97d4-42c0a1f061f0", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
56382025-04-30T06:29:53.764ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
56392025-04-30T06:29:53.764ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
56402025-04-30T06:29:53.764ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
56412025-04-30T06:29:53.766ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
56422025-04-30T06:29:53.766ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56432025-04-30T06:29:53.766ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
56442025-04-30T06:29:53.766ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56452025-04-30T06:29:53.767ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56462025-04-30T06:29:53.771ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56472025-04-30T06:29:53.780ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
56482025-04-30T06:29:53.781ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
56492025-04-30T06:29:53.781ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56502025-04-30T06:29:53.782ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56512025-04-30T06:29:53.824ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
56522025-04-30T06:29:53.833ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
56532025-04-30T06:29:53.833ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
56542025-04-30T06:29:53.833ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 529.904138ms iteration = 14 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
56552025-04-30T06:29:53.833ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 15 reason = Signaled
56562025-04-30T06:29:53.833ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
56572025-04-30T06:29:53.833ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56582025-04-30T06:29:53.833ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
56592025-04-30T06:29:53.833ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56602025-04-30T06:29:53.834ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56612025-04-30T06:29:53.837ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56622025-04-30T06:29:53.846ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
56632025-04-30T06:29:53.846ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
56642025-04-30T06:29:53.846ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56652025-04-30T06:29:53.846ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56662025-04-30T06:29:53.852ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
56672025-04-30T06:29:53.852ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
56682025-04-30T06:29:53.852ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: ab c3 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:62541 req_id = 27299c09-7f44-409f-9afc-b24e576b23a1
56692025-04-30T06:29:53.853ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 43971,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62541 req_id = 27299c09-7f44-409f-9afc-b24e576b23a1
56702025-04-30T06:29:53.853ZDEBGtest_image_create (store): query key key = _mgs._tcp
56712025-04-30T06:29:53.853ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
56722025-04-30T06:29:53.853ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:62541 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 27299c09-7f44-409f-9afc-b24e576b23a1
56732025-04-30T06:29:53.854ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3458, tv_nsec: 653341086 } })
56742025-04-30T06:29:53.854ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
56752025-04-30T06:29:53.855ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 06 a2 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56326 req_id = 29a08562-6403-4ccf-aa01-d95c97b81bc7
56762025-04-30T06:29:53.855ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1698,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56326 req_id = 29a08562-6403-4ccf-aa01-d95c97b81bc7
56772025-04-30T06:29:53.855ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
56782025-04-30T06:29:53.855ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56326 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 29a08562-6403-4ccf-aa01-d95c97b81bc7
56792025-04-30T06:29:53.915ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
56802025-04-30T06:29:53.915ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
56812025-04-30T06:29:53.916ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56822025-04-30T06:29:53.916ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
56832025-04-30T06:29:53.916ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
56842025-04-30T06:29:53.916ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
56852025-04-30T06:29:53.917ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: a6 31 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .1..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:58282 req_id = dac16fb4-2a6c-4095-83ff-0e48e96ebfa1
56862025-04-30T06:29:53.917ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 42545,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58282 req_id = dac16fb4-2a6c-4095-83ff-0e48e96ebfa1
56872025-04-30T06:29:53.917ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
56882025-04-30T06:29:53.917ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42545, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:58282 req_id = dac16fb4-2a6c-4095-83ff-0e48e96ebfa1
56892025-04-30T06:29:53.918ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
56902025-04-30T06:29:53.918ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
56912025-04-30T06:29:53.918ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
56922025-04-30T06:29:53.920ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56932025-04-30T06:29:53.932ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
56942025-04-30T06:29:53.932ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
56952025-04-30T06:29:53.932ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
56962025-04-30T06:29:53.933ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
56972025-04-30T06:29:53.933ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9b2e14f-e96d-4b3f-beba-7ff7c37e79fc", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
56982025-04-30T06:29:53.933ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
56992025-04-30T06:29:53.935ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "074e68e3-4372-47f0-ba1a-91d3563016aa", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57002025-04-30T06:29:53.935ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
57012025-04-30T06:29:53.935ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
57022025-04-30T06:29:53.935ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
57032025-04-30T06:29:53.936ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
57042025-04-30T06:29:53.939ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a04d0222-c169-4969-b6ca-5d0ef6926635", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57052025-04-30T06:29:53.939ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
57062025-04-30T06:29:53.943ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b699b20f-2439-4fe9-a675-09474847d584", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57072025-04-30T06:29:53.943ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
57082025-04-30T06:29:53.944ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f15041d4-25ae-4314-8a19-f960682a8b3b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57092025-04-30T06:29:53.944ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
57102025-04-30T06:29:53.946ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a07ce919-c17c-4ea8-a0ce-e3694be954db", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57112025-04-30T06:29:53.946ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
57122025-04-30T06:29:53.948ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "83b61238-6608-4534-ae19-fa457c54f9f3", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57132025-04-30T06:29:53.948ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
57142025-04-30T06:29:53.951ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2cbcbca-91c5-4a65-a353-7b21f276e63e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57152025-04-30T06:29:53.951ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
57162025-04-30T06:29:53.951ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea781110-ee61-4cd6-8ae0-8f686c7c7989", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57172025-04-30T06:29:53.951ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
57182025-04-30T06:29:53.953ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "096290b7-3979-44e4-911b-5cbdf2fe62df", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57192025-04-30T06:29:53.953ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
57202025-04-30T06:29:53.954ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "89cea2f8-2f2e-40d6-9215-9b48ad1f6e1b", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57212025-04-30T06:29:53.954ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
57222025-04-30T06:29:53.955ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f56fcad0-d4c3-4c13-8a6d-4ab20e956fb7", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57232025-04-30T06:29:53.955ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
57242025-04-30T06:29:53.956ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fc77fed-44fa-4b6f-ad37-2aadbf2e0ef0", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57252025-04-30T06:29:53.957ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
57262025-04-30T06:29:53.960ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f043f0-6c4f-4b88-9cb3-e834688f59af", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57272025-04-30T06:29:53.960ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
57282025-04-30T06:29:53.961ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
57292025-04-30T06:29:53.963ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "70477bf5-df34-40d9-ace0-3e0d70785dd8", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57302025-04-30T06:29:53.963ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
57312025-04-30T06:29:53.965ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8457aa83-a662-4c62-986e-22f7c1bbe09b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57322025-04-30T06:29:53.965ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
57332025-04-30T06:29:53.967ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5f1c7cd-847c-458d-9396-733b288bef24", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57342025-04-30T06:29:53.967ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
57352025-04-30T06:29:53.969ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f8c0b2-5639-4477-9db4-2733605e65bc", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57362025-04-30T06:29:53.969ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
57372025-04-30T06:29:53.971ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1ea74f9-c1bc-408e-9a11-eca9496d933c", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57382025-04-30T06:29:53.971ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
57392025-04-30T06:29:53.972ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a050fd9c-05b0-4c07-a9e0-5b4fc1ed87e4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57402025-04-30T06:29:53.972ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
57412025-04-30T06:29:53.973ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fc3f7d4-aafd-4991-b69c-0a31a61aeb22", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57422025-04-30T06:29:53.973ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
57432025-04-30T06:29:53.975ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb538d30-d3d7-42de-8d85-2f4acf2b3ebc", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57442025-04-30T06:29:53.975ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
57452025-04-30T06:29:53.975ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6da498a9-6373-4811-9f87-eed4af911d68", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57462025-04-30T06:29:53.976ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
57472025-04-30T06:29:53.978ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fec0c70-fcdf-4127-b55d-acbce72a5602", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57482025-04-30T06:29:53.979ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
57492025-04-30T06:29:53.982ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "32d9a1dc-fc85-444f-a812-4b795e420925", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57502025-04-30T06:29:53.982ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
57512025-04-30T06:29:53.984ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8698eb2-87f2-408f-b464-9c5874d7d206", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57522025-04-30T06:29:53.984ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
57532025-04-30T06:29:53.995ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e200a53a-b527-48f7-8814-a47af474ab9c", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57542025-04-30T06:29:53.995ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
57552025-04-30T06:29:54.002ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8fc9510-6964-4bcd-9d7b-f93a6ea0871c", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57562025-04-30T06:29:54.004ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
57572025-04-30T06:29:54.007ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2df2d4a1-d884-453a-b3c7-a8267f00867b", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57582025-04-30T06:29:54.007ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
57592025-04-30T06:29:54.009ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cdda8b8-4b32-4387-8bbf-03d1d57f6d95", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57602025-04-30T06:29:54.009ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
57612025-04-30T06:29:54.010ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "61cb6da9-2a57-4a34-a7d7-21a380369ddd", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57622025-04-30T06:29:54.010ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
57632025-04-30T06:29:54.011ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1912ce-6583-466d-b621-5bad380ec3bd", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57642025-04-30T06:29:54.011ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
57652025-04-30T06:29:54.012ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
57662025-04-30T06:29:54.012ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57672025-04-30T06:29:54.012ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
57682025-04-30T06:29:54.012ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
57692025-04-30T06:29:54.013ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
57702025-04-30T06:29:54.013ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8408469d-a0e9-4a62-8c70-7906fc3a91ed", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57712025-04-30T06:29:54.013ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
57722025-04-30T06:29:54.017ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732025-04-30T06:29:54.027ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
57742025-04-30T06:29:54.027ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
57752025-04-30T06:29:54.027ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
57762025-04-30T06:29:54.027ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
57772025-04-30T06:29:54.035ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c0daffd-9d42-49de-ae98-fbb550b72b68", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57782025-04-30T06:29:54.035ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
57792025-04-30T06:29:54.043ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "57691b14-ab14-4b5f-b2f2-90c47459a5d6", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57802025-04-30T06:29:54.043ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
57812025-04-30T06:29:54.043ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
57822025-04-30T06:29:54.043ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
57832025-04-30T06:29:54.043ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
57842025-04-30T06:29:54.045ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "54f14c3c-92b3-484e-b774-6063eca641f0", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57852025-04-30T06:29:54.045ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
57862025-04-30T06:29:54.052ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "36388ac1-7bbf-463b-b398-6197cbdacdef", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57872025-04-30T06:29:54.052ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
57882025-04-30T06:29:54.059ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b77d560d-7b1f-4c67-9c85-9f620212c804", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57892025-04-30T06:29:54.059ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
57902025-04-30T06:29:54.063ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f277e96b-8673-41ba-9f5b-685883c2243a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57912025-04-30T06:29:54.064ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
57922025-04-30T06:29:54.069ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6da5394-02af-4dae-9ce7-cf74da6e7356", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57932025-04-30T06:29:54.069ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
57942025-04-30T06:29:54.072ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ceaa91d-397f-4749-824e-7e8c421332e3", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57952025-04-30T06:29:54.072ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
57962025-04-30T06:29:54.073ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "23bac71c-79e9-4ed8-b26b-ffc3e7619792", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57972025-04-30T06:29:54.073ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
57982025-04-30T06:29:54.076ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea02d615-a283-46c6-b1ee-c0bf1dab9c56", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
57992025-04-30T06:29:54.076ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
58002025-04-30T06:29:54.076ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
58012025-04-30T06:29:54.077ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54fc3f53-bbc3-42ea-b488-7d6ab408b267", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
58022025-04-30T06:29:54.077ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
58032025-04-30T06:29:54.078ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfa4a58b-0c15-4a38-8419-4ed5959d3167", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
58042025-04-30T06:29:54.078ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
58052025-04-30T06:29:54.079ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58062025-04-30T06:29:54.079ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
58072025-04-30T06:29:54.079ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58082025-04-30T06:29:54.079ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58092025-04-30T06:29:54.081ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58102025-04-30T06:29:54.088ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
58112025-04-30T06:29:54.088ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
58122025-04-30T06:29:54.088ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58132025-04-30T06:29:54.088ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
58142025-04-30T06:29:54.088ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58152025-04-30T06:29:54.089ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58162025-04-30T06:29:54.094ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58172025-04-30T06:29:54.096ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
58182025-04-30T06:29:54.096ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
58192025-04-30T06:29:54.097ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58202025-04-30T06:29:54.097ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58212025-04-30T06:29:54.165ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
58222025-04-30T06:29:54.165ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
58232025-04-30T06:29:54.166ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
58242025-04-30T06:29:54.166ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58252025-04-30T06:29:54.166ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
58262025-04-30T06:29:54.166ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
58272025-04-30T06:29:54.167ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
58282025-04-30T06:29:54.167ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:64302 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
58292025-04-30T06:29:54.167ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:64302 req_id = 2af2edfa-0319-46d0-a64c-2ea1f3c60d55 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
58302025-04-30T06:29:54.168ZINFOtest_image_create (dropshot): request completed latency_us = 523 local_addr = [::1]:42828 method = GET remote_addr = [::1]:64302 req_id = 2af2edfa-0319-46d0-a64c-2ea1f3c60d55 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
58312025-04-30T06:29:54.169ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2af2edfa-0319-46d0-a64c-2ea1f3c60d55", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:53 GMT"} })
58322025-04-30T06:29:54.173ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
58332025-04-30T06:29:54.174ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
58342025-04-30T06:29:54.174ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
58352025-04-30T06:29:54.177ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
58362025-04-30T06:29:54.177ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58372025-04-30T06:29:54.178ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
58382025-04-30T06:29:54.178ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58392025-04-30T06:29:54.181ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58402025-04-30T06:29:54.182ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58412025-04-30T06:29:54.190ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
58422025-04-30T06:29:54.190ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
58432025-04-30T06:29:54.190ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
58442025-04-30T06:29:54.191ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
58452025-04-30T06:29:54.193ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58462025-04-30T06:29:54.197ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
58472025-04-30T06:29:54.197ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
58482025-04-30T06:29:54.197ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58492025-04-30T06:29:54.197ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58502025-04-30T06:29:54.199ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
58512025-04-30T06:29:54.199ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
58522025-04-30T06:29:54.199ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
58532025-04-30T06:29:54.234ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
58542025-04-30T06:29:54.234ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
58552025-04-30T06:29:54.234ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 401.317219ms iteration = 15 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
58562025-04-30T06:29:54.234ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 16 reason = Signaled
58572025-04-30T06:29:54.234ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
58582025-04-30T06:29:54.234ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58592025-04-30T06:29:54.235ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
58602025-04-30T06:29:54.235ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58612025-04-30T06:29:54.235ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58622025-04-30T06:29:54.244ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
58632025-04-30T06:29:54.245ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58642025-04-30T06:29:54.249ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
58652025-04-30T06:29:54.252ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
58662025-04-30T06:29:54.252ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58672025-04-30T06:29:54.253ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58682025-04-30T06:29:54.257ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
58692025-04-30T06:29:54.257ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
58702025-04-30T06:29:54.258ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: bb 40 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .@..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:57593 req_id = dff3b857-6fe7-4bd8-a9aa-0daa7262d1b7
58712025-04-30T06:29:54.258ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 47936,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57593 req_id = dff3b857-6fe7-4bd8-a9aa-0daa7262d1b7
58722025-04-30T06:29:54.258ZDEBGtest_image_create (store): query key key = _mgs._tcp
58732025-04-30T06:29:54.259ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
58742025-04-30T06:29:54.259ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:57593 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = dff3b857-6fe7-4bd8-a9aa-0daa7262d1b7
58752025-04-30T06:29:54.259ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3459, tv_nsec: 58465921 } })
58762025-04-30T06:29:54.259ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
58772025-04-30T06:29:54.260ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 0b 8e 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:62751 req_id = 2c4a1421-5865-423e-9b54-e3bc835e09bf
58782025-04-30T06:29:54.260ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2958,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62751 req_id = 2c4a1421-5865-423e-9b54-e3bc835e09bf
58792025-04-30T06:29:54.260ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
58802025-04-30T06:29:54.260ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62751 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 2c4a1421-5865-423e-9b54-e3bc835e09bf
58812025-04-30T06:29:54.311ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
58822025-04-30T06:29:54.312ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
58832025-04-30T06:29:54.312ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58842025-04-30T06:29:54.312ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
58852025-04-30T06:29:54.312ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
58862025-04-30T06:29:54.313ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
58872025-04-30T06:29:54.314ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 74 b9 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c t............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:58396 req_id = 5140219e-9981-43fd-abee-ccefcd1f56a7
58882025-04-30T06:29:54.314ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 29881,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58396 req_id = 5140219e-9981-43fd-abee-ccefcd1f56a7
58892025-04-30T06:29:54.314ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
58902025-04-30T06:29:54.314ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29881, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:58396 req_id = 5140219e-9981-43fd-abee-ccefcd1f56a7
58912025-04-30T06:29:54.315ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
58922025-04-30T06:29:54.315ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
58932025-04-30T06:29:54.315ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
58942025-04-30T06:29:54.316ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58952025-04-30T06:29:54.322ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
58962025-04-30T06:29:54.322ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
58972025-04-30T06:29:54.322ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
58982025-04-30T06:29:54.323ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
58992025-04-30T06:29:54.327ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "06c4b16d-a561-40df-abbc-e581cdafa865", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59002025-04-30T06:29:54.328ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
59012025-04-30T06:29:54.328ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
59022025-04-30T06:29:54.328ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
59032025-04-30T06:29:54.329ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
59042025-04-30T06:29:54.333ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "473461fa-c15f-414e-a05b-b49dc749bcdd", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59052025-04-30T06:29:54.333ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
59062025-04-30T06:29:54.339ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "89917fdf-6646-465a-a36d-9d70c1d5b144", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59072025-04-30T06:29:54.339ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
59082025-04-30T06:29:54.345ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "009eabc4-7e75-486c-8b42-c3995c07ca6c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59092025-04-30T06:29:54.345ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
59102025-04-30T06:29:54.349ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "de179022-fa21-4452-a810-5343c260942f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59112025-04-30T06:29:54.350ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
59122025-04-30T06:29:54.354ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38699ad6-753f-4ce0-bb6f-cd0b680774b7", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59132025-04-30T06:29:54.354ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
59142025-04-30T06:29:54.358ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
59152025-04-30T06:29:54.361ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "781b267b-925f-4826-ab64-874629d63d0e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59162025-04-30T06:29:54.361ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
59172025-04-30T06:29:54.364ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2d7e08-b4c9-45f9-a7f5-f818610d700f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59182025-04-30T06:29:54.364ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
59192025-04-30T06:29:54.365ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f93effc-f83e-4572-9054-717f281d8201", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59202025-04-30T06:29:54.366ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
59212025-04-30T06:29:54.367ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1762660-0e32-463a-950f-954f1ed9897b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59222025-04-30T06:29:54.367ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
59232025-04-30T06:29:54.369ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "425cb772-5575-4ee6-b463-f03749b727e5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59242025-04-30T06:29:54.369ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
59252025-04-30T06:29:54.370ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "278e625f-9020-431b-ae04-2999d2b0e1a6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59262025-04-30T06:29:54.370ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
59272025-04-30T06:29:54.373ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "94f7a2f8-a53d-4355-a9b5-4b786ad89ef7", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59282025-04-30T06:29:54.373ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
59292025-04-30T06:29:54.376ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b4fe141-40d2-4ea4-b0e9-f3cbd520de70", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59302025-04-30T06:29:54.376ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
59312025-04-30T06:29:54.385ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2b45878-05dc-4573-b67e-0e533eb6a5fc", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59322025-04-30T06:29:54.386ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
59332025-04-30T06:29:54.388ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "44387570-8f99-4e87-8410-141b04ff3883", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59342025-04-30T06:29:54.388ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
59352025-04-30T06:29:54.389ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a1c43c8-7add-4097-a2b1-838f6faf3c62", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59362025-04-30T06:29:54.389ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
59372025-04-30T06:29:54.391ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "762c7421-a807-417c-b2da-a34d692921ac", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59382025-04-30T06:29:54.391ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
59392025-04-30T06:29:54.395ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "191dfd61-43df-4350-a986-e279643fc2eb", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59402025-04-30T06:29:54.396ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
59412025-04-30T06:29:54.397ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f933ca4-f3eb-45a8-842b-87e9b12a9ca3", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59422025-04-30T06:29:54.397ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
59432025-04-30T06:29:54.398ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2a5e422-7258-4d15-9af5-997110f138ce", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59442025-04-30T06:29:54.398ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
59452025-04-30T06:29:54.399ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3b7918d-7d47-4370-9421-c755c71031e9", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59462025-04-30T06:29:54.399ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
59472025-04-30T06:29:54.400ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "44915be2-daca-4ef2-a316-d852cdc4e42a", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59482025-04-30T06:29:54.400ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
59492025-04-30T06:29:54.402ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e77a600e-3f53-40f6-9d05-2284b1db263b", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59502025-04-30T06:29:54.402ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
59512025-04-30T06:29:54.404ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ceeebeea-7292-4685-ab9e-58e2ad131f19", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59522025-04-30T06:29:54.404ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
59532025-04-30T06:29:54.407ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2516c470-0ecd-42e8-bb58-6e32e1edae66", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59542025-04-30T06:29:54.407ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
59552025-04-30T06:29:54.408ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "14d5525c-882f-479d-a879-7c293e6efb66", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59562025-04-30T06:29:54.409ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
59572025-04-30T06:29:54.409ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
59582025-04-30T06:29:54.409ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59592025-04-30T06:29:54.409ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
59602025-04-30T06:29:54.409ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
59612025-04-30T06:29:54.409ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
59622025-04-30T06:29:54.416ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59632025-04-30T06:29:54.428ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
59642025-04-30T06:29:54.429ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
59652025-04-30T06:29:54.429ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
59662025-04-30T06:29:54.429ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
59672025-04-30T06:29:54.430ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
59682025-04-30T06:29:54.430ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
59692025-04-30T06:29:54.432ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a233472-138f-4fda-92ad-76a9c5f08779", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59702025-04-30T06:29:54.432ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
59712025-04-30T06:29:54.433ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
59722025-04-30T06:29:54.434ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
59732025-04-30T06:29:54.434ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
59742025-04-30T06:29:54.435ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
59752025-04-30T06:29:54.435ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
59762025-04-30T06:29:54.436ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
59772025-04-30T06:29:54.436ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
59782025-04-30T06:29:54.440ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5a51b7c-ef08-4243-ab16-da3880dcdc9c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59792025-04-30T06:29:54.440ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
59802025-04-30T06:29:54.444ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aef1b35d-93c3-4097-be9d-a9ccc7d19de0", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59812025-04-30T06:29:54.444ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
59822025-04-30T06:29:54.446ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e177991f-d57b-4772-a24b-e9f0452c1aa8", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59832025-04-30T06:29:54.446ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
59842025-04-30T06:29:54.447ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5c89510-19f0-40de-a1f8-2be7a38ea957", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59852025-04-30T06:29:54.448ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
59862025-04-30T06:29:54.450ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fe63e44-76d2-411e-8ac8-f944aac712a1", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59872025-04-30T06:29:54.450ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
59882025-04-30T06:29:54.451ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5de59ca-0e95-4d38-bbe9-b72463db6dc8", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59892025-04-30T06:29:54.452ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
59902025-04-30T06:29:54.453ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5a2bade-3aba-4865-a0d2-f113670fde90", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59912025-04-30T06:29:54.454ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
59922025-04-30T06:29:54.457ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "40774b34-e14c-45f7-9e1f-1718d2b0e8fd", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59932025-04-30T06:29:54.457ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
59942025-04-30T06:29:54.465ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3d7e1f2-b037-4a2f-9661-a6297585cb10", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59952025-04-30T06:29:54.465ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
59962025-04-30T06:29:54.466ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
59972025-04-30T06:29:54.469ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9031e47e-f410-4c8e-9c1a-abcb90786b09", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
59982025-04-30T06:29:54.469ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
59992025-04-30T06:29:54.471ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "945f777d-88e7-4a36-8c1b-6477214cc937", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60002025-04-30T06:29:54.471ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
60012025-04-30T06:29:54.472ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b94acd22-1e8e-461f-abac-6b08f068530a", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60022025-04-30T06:29:54.473ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
60032025-04-30T06:29:54.475ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcf9c40e-8dcf-43ad-9fe9-14f11bfc88c9", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60042025-04-30T06:29:54.475ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
60052025-04-30T06:29:54.476ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "575e745e-94b2-4cba-80d7-7cde18e19aad", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60062025-04-30T06:29:54.476ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
60072025-04-30T06:29:54.478ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c714f51e-72f6-42f3-a9bf-d7ad3481514d", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60082025-04-30T06:29:54.478ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
60092025-04-30T06:29:54.480ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c2cea6e-8319-4f47-a475-8c111d53a06b", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60102025-04-30T06:29:54.480ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
60112025-04-30T06:29:54.484ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d790597-682f-4806-9e97-bfd46aa0fa03", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60122025-04-30T06:29:54.484ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
60132025-04-30T06:29:54.484ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60142025-04-30T06:29:54.484ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
60152025-04-30T06:29:54.484ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
60162025-04-30T06:29:54.485ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
60172025-04-30T06:29:54.492ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60182025-04-30T06:29:54.501ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
60192025-04-30T06:29:54.501ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
60202025-04-30T06:29:54.501ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60212025-04-30T06:29:54.501ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
60222025-04-30T06:29:54.501ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
60232025-04-30T06:29:54.502ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
60242025-04-30T06:29:54.510ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60252025-04-30T06:29:54.516ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
60262025-04-30T06:29:54.516ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
60272025-04-30T06:29:54.516ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
60282025-04-30T06:29:54.517ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
60292025-04-30T06:29:54.518ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
60302025-04-30T06:29:54.518ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60312025-04-30T06:29:54.518ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
60322025-04-30T06:29:54.518ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
60332025-04-30T06:29:54.518ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
60342025-04-30T06:29:54.519ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60352025-04-30T06:29:54.519ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60362025-04-30T06:29:54.520ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
60372025-04-30T06:29:54.520ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
60382025-04-30T06:29:54.575ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
60392025-04-30T06:29:54.575ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
60402025-04-30T06:29:54.575ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60412025-04-30T06:29:54.582ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
60422025-04-30T06:29:54.582ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
60432025-04-30T06:29:54.582ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
60442025-04-30T06:29:54.583ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
60452025-04-30T06:29:54.583ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:39459 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
60462025-04-30T06:29:54.583ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
60472025-04-30T06:29:54.583ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
60482025-04-30T06:29:54.587ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:39459 req_id = 381197e6-374d-45b3-a26c-dc03112c538b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
60492025-04-30T06:29:54.600ZINFOtest_image_create (dropshot): request completed latency_us = 14485 local_addr = [::1]:42828 method = GET remote_addr = [::1]:39459 req_id = 381197e6-374d-45b3-a26c-dc03112c538b response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
60502025-04-30T06:29:54.602ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
60512025-04-30T06:29:54.602ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60522025-04-30T06:29:54.603ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "381197e6-374d-45b3-a26c-dc03112c538b", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
60532025-04-30T06:29:54.607ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
60542025-04-30T06:29:54.607ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
60552025-04-30T06:29:54.607ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
60562025-04-30T06:29:54.609ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
60572025-04-30T06:29:54.609ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60582025-04-30T06:29:54.609ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
60592025-04-30T06:29:54.609ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
60602025-04-30T06:29:54.610ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
60612025-04-30T06:29:54.611ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
60622025-04-30T06:29:54.611ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
60632025-04-30T06:29:54.611ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
60642025-04-30T06:29:54.619ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60652025-04-30T06:29:54.625ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
60662025-04-30T06:29:54.626ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
60672025-04-30T06:29:54.626ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
60682025-04-30T06:29:54.627ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
60692025-04-30T06:29:54.632ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
60702025-04-30T06:29:54.663ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
60712025-04-30T06:29:54.664ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
60722025-04-30T06:29:54.665ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 430.161289ms iteration = 16 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
60732025-04-30T06:29:54.665ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 17 reason = Signaled
60742025-04-30T06:29:54.665ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
60752025-04-30T06:29:54.665ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60762025-04-30T06:29:54.665ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
60772025-04-30T06:29:54.665ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
60782025-04-30T06:29:54.667ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
60792025-04-30T06:29:54.670ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60802025-04-30T06:29:54.675ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
60812025-04-30T06:29:54.676ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
60822025-04-30T06:29:54.676ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
60832025-04-30T06:29:54.676ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
60842025-04-30T06:29:54.677ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
60852025-04-30T06:29:54.717ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
60862025-04-30T06:29:54.717ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
60872025-04-30T06:29:54.717ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 69 01 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 i............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:64312 req_id = 14a461c1-8e68-4b6a-bebe-777ace68a637
60882025-04-30T06:29:54.717ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 26881,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64312 req_id = 14a461c1-8e68-4b6a-bebe-777ace68a637
60892025-04-30T06:29:54.717ZDEBGtest_image_create (store): query key key = _mgs._tcp
60902025-04-30T06:29:54.718ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
60912025-04-30T06:29:54.718ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:64312 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 14a461c1-8e68-4b6a-bebe-777ace68a637
60922025-04-30T06:29:54.718ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3459, tv_nsec: 517535377 } })
60932025-04-30T06:29:54.718ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
60942025-04-30T06:29:54.719ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 1a 9e 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:63535 req_id = 2685411b-bc3a-4b7d-ab75-2b1b5812a046
60952025-04-30T06:29:54.719ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 6814,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63535 req_id = 2685411b-bc3a-4b7d-ab75-2b1b5812a046
60962025-04-30T06:29:54.719ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
60972025-04-30T06:29:54.719ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:63535 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 2685411b-bc3a-4b7d-ab75-2b1b5812a046
60982025-04-30T06:29:54.762ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
60992025-04-30T06:29:54.762ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
61002025-04-30T06:29:54.762ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61012025-04-30T06:29:54.762ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
61022025-04-30T06:29:54.762ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
61032025-04-30T06:29:54.763ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
61042025-04-30T06:29:54.763ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 02 17 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:57524 req_id = 7f3baffe-c3f6-431c-966a-49eac0d1edb0
61052025-04-30T06:29:54.763ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 535,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57524 req_id = 7f3baffe-c3f6-431c-966a-49eac0d1edb0
61062025-04-30T06:29:54.764ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
61072025-04-30T06:29:54.765ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 535, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:57524 req_id = 7f3baffe-c3f6-431c-966a-49eac0d1edb0
61082025-04-30T06:29:54.765ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
61092025-04-30T06:29:54.765ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
61102025-04-30T06:29:54.765ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
61112025-04-30T06:29:54.766ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122025-04-30T06:29:54.772ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
61132025-04-30T06:29:54.773ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
61142025-04-30T06:29:54.773ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
61152025-04-30T06:29:54.773ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
61162025-04-30T06:29:54.774ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ca1c241-54fa-4d1c-962a-a8536a12b916", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61172025-04-30T06:29:54.775ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
61182025-04-30T06:29:54.776ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
61192025-04-30T06:29:54.776ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
61202025-04-30T06:29:54.778ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
61212025-04-30T06:29:54.779ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bbb0c27-287d-4090-9311-19e7a6d56b39", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61222025-04-30T06:29:54.779ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
61232025-04-30T06:29:54.783ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b4485ca-10d5-4a6c-9d99-e632c226a16b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61242025-04-30T06:29:54.783ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
61252025-04-30T06:29:54.787ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "68debf73-020b-4ac0-8fdd-140a26aff840", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61262025-04-30T06:29:54.787ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
61272025-04-30T06:29:54.789ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4926ab20-1786-4b7e-9c7e-e59203585ba3", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61282025-04-30T06:29:54.789ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
61292025-04-30T06:29:54.791ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eff48a9-57da-42ad-b859-2d1293c52980", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61302025-04-30T06:29:54.791ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
61312025-04-30T06:29:54.793ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7331e7e-4d8b-4eff-a743-b2d640ee59e1", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61322025-04-30T06:29:54.794ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
61332025-04-30T06:29:54.797ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b325290-468b-4dc6-b06e-c6e891cbf567", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61342025-04-30T06:29:54.797ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
61352025-04-30T06:29:54.798ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d49f7337-cc3f-46b9-b44f-63dce096fd3a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61362025-04-30T06:29:54.798ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
61372025-04-30T06:29:54.799ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb162452-9729-4753-bba4-04f76a379688", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61382025-04-30T06:29:54.799ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
61392025-04-30T06:29:54.800ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2e90bb9-c49c-4c1b-a350-219f541838aa", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61402025-04-30T06:29:54.801ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
61412025-04-30T06:29:54.804ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "86835145-740e-42aa-9704-78600b11aa8f", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61422025-04-30T06:29:54.804ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
61432025-04-30T06:29:54.809ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3fa705e-4ba4-4afc-9aa9-49f622fda2bc", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61442025-04-30T06:29:54.810ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
61452025-04-30T06:29:54.820ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
61462025-04-30T06:29:54.842ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "654ff0f2-74cb-4562-b96d-be63ff770db5", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61472025-04-30T06:29:54.842ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
61482025-04-30T06:29:54.845ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "638038ae-28d9-40b6-9259-a61dfc70866a", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61492025-04-30T06:29:54.845ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
61502025-04-30T06:29:54.847ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cccaf08-f85a-4af8-ba66-f6f6aa89a4be", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61512025-04-30T06:29:54.847ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
61522025-04-30T06:29:54.853ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "14501581-beb3-4f3c-bc3c-131fb3e3ad9f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61532025-04-30T06:29:54.853ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
61542025-04-30T06:29:54.855ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6738dcb-d0aa-4fa9-95cc-92e80b6b1415", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61552025-04-30T06:29:54.855ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
61562025-04-30T06:29:54.857ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "01186bbc-adc2-4fd7-8ab3-404e2a93a716", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61572025-04-30T06:29:54.857ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
61582025-04-30T06:29:54.858ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd3d847f-6551-4017-b7f7-13f222326b25", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61592025-04-30T06:29:54.859ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
61602025-04-30T06:29:54.860ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a732705-5f78-4a7c-bb07-a78761fe81f0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61612025-04-30T06:29:54.860ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
61622025-04-30T06:29:54.861ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5f1ae6-7937-4374-8712-a5dbe698dfa5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61632025-04-30T06:29:54.861ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
61642025-04-30T06:29:54.862ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9aab912-be76-4a20-b2af-4b23289f64f9", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61652025-04-30T06:29:54.863ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
61662025-04-30T06:29:54.864ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "83916ce5-fb32-4f77-b455-5d0a126ea114", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61672025-04-30T06:29:54.864ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
61682025-04-30T06:29:54.866ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "32c37657-9ac7-42a4-b343-34e9bae854b6", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61692025-04-30T06:29:54.866ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
61702025-04-30T06:29:54.868ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa9f5757-0630-4ac0-ae2a-d77f791642e6", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61712025-04-30T06:29:54.868ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
61722025-04-30T06:29:54.883ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
61732025-04-30T06:29:54.883ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61742025-04-30T06:29:54.883ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
61752025-04-30T06:29:54.883ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
61762025-04-30T06:29:54.886ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
61772025-04-30T06:29:54.889ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61782025-04-30T06:29:54.896ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
61792025-04-30T06:29:54.896ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
61802025-04-30T06:29:54.896ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
61812025-04-30T06:29:54.897ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
61822025-04-30T06:29:54.899ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
61832025-04-30T06:29:54.899ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
61842025-04-30T06:29:54.900ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
61852025-04-30T06:29:54.900ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "326786eb-e117-4a32-94e4-8d1173c663e1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61862025-04-30T06:29:54.900ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
61872025-04-30T06:29:54.904ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e88d9ace-4158-4111-a159-ae7b74c81536", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61882025-04-30T06:29:54.904ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
61892025-04-30T06:29:54.908ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "58faa738-6994-498e-9b3b-ec3d28ba3e58", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61902025-04-30T06:29:54.908ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
61912025-04-30T06:29:54.912ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1210a3ec-1257-42e5-8340-0668f90c313b", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61922025-04-30T06:29:54.912ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
61932025-04-30T06:29:54.914ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "33b5c1e1-c20a-4043-995e-6fd472abbb1f", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61942025-04-30T06:29:54.914ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
61952025-04-30T06:29:54.915ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac19d7f5-1aee-4b1d-8fda-51883164a2df", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61962025-04-30T06:29:54.915ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
61972025-04-30T06:29:54.917ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "61a07af3-09c8-46d1-b08a-a2a34ca140bd", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
61982025-04-30T06:29:54.917ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
61992025-04-30T06:29:54.918ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "92a1713b-57e3-4096-b0c5-555cfc56519b", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62002025-04-30T06:29:54.919ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
62012025-04-30T06:29:54.920ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2702a134-0650-4847-b768-83e697cad161", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62022025-04-30T06:29:54.921ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
62032025-04-30T06:29:54.923ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "69876b4a-fc8b-4ea4-a937-a1034b1e91f8", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62042025-04-30T06:29:54.923ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
62052025-04-30T06:29:54.927ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af4fe437-8a7c-4381-8162-211dfa49bb9f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62062025-04-30T06:29:54.927ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
62072025-04-30T06:29:54.928ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
62082025-04-30T06:29:54.930ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "965fe269-0c8a-4174-a13b-697f7c80428e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62092025-04-30T06:29:54.930ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
62102025-04-30T06:29:54.934ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dd4dad6-04e6-45b7-b307-cb9e6f3e2bc1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62112025-04-30T06:29:54.934ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
62122025-04-30T06:29:54.937ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d555ffa-f539-45c0-8ac2-b28d1e311d28", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62132025-04-30T06:29:54.937ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
62142025-04-30T06:29:54.940ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a66646a-1624-4ec6-9997-0022b2b5d7e7", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62152025-04-30T06:29:54.940ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
62162025-04-30T06:29:54.941ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0faeb01d-d36e-43cb-aa9c-6bc961215a21", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62172025-04-30T06:29:54.941ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
62182025-04-30T06:29:54.943ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6134e6dd-cf79-4325-ba15-eeb8f4ebb37b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62192025-04-30T06:29:54.943ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
62202025-04-30T06:29:54.945ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d8bbb2c-87c0-4cc6-affa-29e98dbe15fb", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62212025-04-30T06:29:54.945ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
62222025-04-30T06:29:54.946ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "27337ba0-8287-447f-bcdc-661960933e41", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62232025-04-30T06:29:54.946ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
62242025-04-30T06:29:54.946ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62252025-04-30T06:29:54.946ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
62262025-04-30T06:29:54.946ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62272025-04-30T06:29:54.947ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62282025-04-30T06:29:54.949ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62292025-04-30T06:29:54.955ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
62302025-04-30T06:29:54.955ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
62312025-04-30T06:29:54.955ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62322025-04-30T06:29:54.955ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
62332025-04-30T06:29:54.955ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62342025-04-30T06:29:54.955ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62352025-04-30T06:29:54.959ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62362025-04-30T06:29:54.966ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
62372025-04-30T06:29:54.966ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
62382025-04-30T06:29:54.966ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62392025-04-30T06:29:54.967ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62402025-04-30T06:29:55.030ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
62412025-04-30T06:29:55.030ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
62422025-04-30T06:29:55.030ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
62432025-04-30T06:29:55.030ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62442025-04-30T06:29:55.030ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
62452025-04-30T06:29:55.030ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
62462025-04-30T06:29:55.031ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
62472025-04-30T06:29:55.031ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:34139 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
62482025-04-30T06:29:55.032ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:34139 req_id = 9ee2b3c0-25f0-433b-a156-f94ab6c2c447 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
62492025-04-30T06:29:55.032ZINFOtest_image_create (dropshot): request completed latency_us = 465 local_addr = [::1]:42828 method = GET remote_addr = [::1]:34139 req_id = 9ee2b3c0-25f0-433b-a156-f94ab6c2c447 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
62502025-04-30T06:29:55.033ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ee2b3c0-25f0-433b-a156-f94ab6c2c447", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
62512025-04-30T06:29:55.035ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
62522025-04-30T06:29:55.035ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
62532025-04-30T06:29:55.035ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
62542025-04-30T06:29:55.037ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
62552025-04-30T06:29:55.037ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62562025-04-30T06:29:55.037ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
62572025-04-30T06:29:55.037ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62582025-04-30T06:29:55.038ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62592025-04-30T06:29:55.038ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62602025-04-30T06:29:55.043ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
62612025-04-30T06:29:55.043ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
62622025-04-30T06:29:55.044ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
62632025-04-30T06:29:55.044ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
62642025-04-30T06:29:55.046ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62652025-04-30T06:29:55.050ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
62662025-04-30T06:29:55.050ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
62672025-04-30T06:29:55.050ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62682025-04-30T06:29:55.050ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62692025-04-30T06:29:55.053ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
62702025-04-30T06:29:55.053ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
62712025-04-30T06:29:55.053ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
62722025-04-30T06:29:55.087ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
62732025-04-30T06:29:55.087ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
62742025-04-30T06:29:55.087ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 422.299013ms iteration = 17 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
62752025-04-30T06:29:55.087ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 18 reason = Signaled
62762025-04-30T06:29:55.087ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
62772025-04-30T06:29:55.087ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62782025-04-30T06:29:55.087ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
62792025-04-30T06:29:55.087ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62802025-04-30T06:29:55.088ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62812025-04-30T06:29:55.091ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822025-04-30T06:29:55.096ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
62832025-04-30T06:29:55.096ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
62842025-04-30T06:29:55.096ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62852025-04-30T06:29:55.097ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62862025-04-30T06:29:55.102ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
62872025-04-30T06:29:55.102ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
62882025-04-30T06:29:55.103ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 61 f3 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 a............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:53619 req_id = 106d71d6-6186-428c-a162-8f801d4beab2
62892025-04-30T06:29:55.103ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25075,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:53619 req_id = 106d71d6-6186-428c-a162-8f801d4beab2
62902025-04-30T06:29:55.103ZDEBGtest_image_create (store): query key key = _mgs._tcp
62912025-04-30T06:29:55.103ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
62922025-04-30T06:29:55.103ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:53619 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 106d71d6-6186-428c-a162-8f801d4beab2
62932025-04-30T06:29:55.105ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
62942025-04-30T06:29:55.105ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3459, tv_nsec: 904575840 } })
62952025-04-30T06:29:55.105ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
62962025-04-30T06:29:55.106ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: d6 f7 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:63248 req_id = 2b4927c7-5bcd-4f70-b569-8ffa41daf7c0
62972025-04-30T06:29:55.107ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 55031,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63248 req_id = 2b4927c7-5bcd-4f70-b569-8ffa41daf7c0
62982025-04-30T06:29:55.107ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
62992025-04-30T06:29:55.107ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:63248 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 2b4927c7-5bcd-4f70-b569-8ffa41daf7c0
63002025-04-30T06:29:55.170ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
63012025-04-30T06:29:55.170ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
63022025-04-30T06:29:55.170ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63032025-04-30T06:29:55.170ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
63042025-04-30T06:29:55.170ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
63052025-04-30T06:29:55.171ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
63062025-04-30T06:29:55.171ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 87 da 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:59309 req_id = f1d145d9-3fb7-4647-bde5-40495e61db9f
63072025-04-30T06:29:55.172ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 34778,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59309 req_id = f1d145d9-3fb7-4647-bde5-40495e61db9f
63082025-04-30T06:29:55.172ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
63092025-04-30T06:29:55.172ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34778, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59309 req_id = f1d145d9-3fb7-4647-bde5-40495e61db9f
63102025-04-30T06:29:55.172ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
63112025-04-30T06:29:55.172ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
63122025-04-30T06:29:55.172ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
63132025-04-30T06:29:55.174ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d626f2de-7f3f-4d7a-93c9-9e1696ab1c61", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63142025-04-30T06:29:55.175ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
63152025-04-30T06:29:55.176ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b2c4a18-a9ca-4ac5-8bf5-7d667e960508", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63162025-04-30T06:29:55.176ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
63172025-04-30T06:29:55.177ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63182025-04-30T06:29:55.182ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
63192025-04-30T06:29:55.183ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
63202025-04-30T06:29:55.183ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
63212025-04-30T06:29:55.183ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
63222025-04-30T06:29:55.186ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb0cd5e9-b67b-48fc-862e-9c846929f7b8", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63232025-04-30T06:29:55.186ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
63242025-04-30T06:29:55.187ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
63252025-04-30T06:29:55.188ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
63262025-04-30T06:29:55.188ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
63272025-04-30T06:29:55.190ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "53be6d65-3ef9-4efb-af9d-e3396275a614", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63282025-04-30T06:29:55.190ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
63292025-04-30T06:29:55.193ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e94eb78-c839-4095-abdd-caf908544315", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63302025-04-30T06:29:55.193ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
63312025-04-30T06:29:55.195ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bd9ae9d-87da-4212-aff1-9109a53f2147", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63322025-04-30T06:29:55.196ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
63332025-04-30T06:29:55.198ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "725ac2fb-df11-46b2-a069-cc07f3f006a9", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63342025-04-30T06:29:55.199ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
63352025-04-30T06:29:55.201ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa0ef6b7-63b7-4ce5-9dce-076cc409f2a4", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63362025-04-30T06:29:55.201ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
63372025-04-30T06:29:55.202ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46320d37-28f1-4ea2-a48d-f81bb20f4122", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63382025-04-30T06:29:55.202ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
63392025-04-30T06:29:55.204ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5d5d917-f4c9-48e0-9f99-838e5b8d978b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63402025-04-30T06:29:55.204ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
63412025-04-30T06:29:55.206ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c3746f-536d-47c2-aca2-909b3689ac51", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63422025-04-30T06:29:55.206ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
63432025-04-30T06:29:55.207ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5deed1-076e-4a89-9825-dfc5da9a06ea", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63442025-04-30T06:29:55.207ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
63452025-04-30T06:29:55.209ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ae0e6b9-edb7-458d-8172-73689468c4a5", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63462025-04-30T06:29:55.209ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
63472025-04-30T06:29:55.212ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a430848a-dc82-4177-8342-0fc390a4705a", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63482025-04-30T06:29:55.212ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
63492025-04-30T06:29:55.214ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb14aff-ac34-403f-ad5c-59426f4661fd", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63502025-04-30T06:29:55.215ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
63512025-04-30T06:29:55.218ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
63522025-04-30T06:29:55.219ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "36a4cf73-b38a-4d9e-83f5-1769675d1b17", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63532025-04-30T06:29:55.219ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
63542025-04-30T06:29:55.222ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "70a9f47e-8e88-4350-9258-7328f9adf0c4", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63552025-04-30T06:29:55.222ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
63562025-04-30T06:29:55.224ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "66bbf134-ad1d-4c43-9bb4-6b55683d0ced", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63572025-04-30T06:29:55.224ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
63582025-04-30T06:29:55.226ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cccf7bf-d790-4dfd-a2c6-552ebf4f866d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63592025-04-30T06:29:55.227ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
63602025-04-30T06:29:55.227ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab7a0e7f-1765-441d-93f6-fa37711a07c4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63612025-04-30T06:29:55.228ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
63622025-04-30T06:29:55.230ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fa94cda-6c11-4177-b300-5f85e07e6cb2", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63632025-04-30T06:29:55.230ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
63642025-04-30T06:29:55.231ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "713d9812-1326-45e8-96b7-1cc2cf3d2d1c", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63652025-04-30T06:29:55.231ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
63662025-04-30T06:29:55.233ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "499330ad-bb9a-41a9-8008-a4e76851a443", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63672025-04-30T06:29:55.233ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
63682025-04-30T06:29:55.234ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fccd1f05-dea9-4857-b67a-9e4a48c6cd64", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63692025-04-30T06:29:55.234ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
63702025-04-30T06:29:55.238ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "654d5f74-196d-4345-9689-bda5d0d86898", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63712025-04-30T06:29:55.238ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
63722025-04-30T06:29:55.240ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "195f957d-8c8d-43df-b7cc-4312bf9a36cd", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63732025-04-30T06:29:55.240ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
63742025-04-30T06:29:55.243ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d62d089-505b-4799-b592-0515f39831d4", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63752025-04-30T06:29:55.243ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
63762025-04-30T06:29:55.245ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbefdc10-998b-4ec5-9643-68ce24f7bb7d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63772025-04-30T06:29:55.246ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
63782025-04-30T06:29:55.247ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6476f1-2855-40c9-b461-9ccba4b6093d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63792025-04-30T06:29:55.248ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
63802025-04-30T06:29:55.251ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d56a364c-cc30-443e-8d3c-60dbd4a246bb", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63812025-04-30T06:29:55.252ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
63822025-04-30T06:29:55.253ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b012dd1-3702-4c5a-b499-62be78697c27", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63832025-04-30T06:29:55.253ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
63842025-04-30T06:29:55.260ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bccc081-f652-4adf-98be-a78f358078fe", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63852025-04-30T06:29:55.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
63862025-04-30T06:29:55.264ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e122355-cd69-43fa-b751-031331394171", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63872025-04-30T06:29:55.264ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
63882025-04-30T06:29:55.266ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d912d6e-7277-4643-833a-781a0debf3d1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63892025-04-30T06:29:55.266ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
63902025-04-30T06:29:55.268ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2809650-0150-463f-84ad-ee53893033ad", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63912025-04-30T06:29:55.268ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
63922025-04-30T06:29:55.269ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
63932025-04-30T06:29:55.269ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63942025-04-30T06:29:55.269ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
63952025-04-30T06:29:55.269ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
63962025-04-30T06:29:55.270ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
63972025-04-30T06:29:55.272ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa47299a-4c2c-43df-a3ba-626cd30ddfe1", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
63982025-04-30T06:29:55.272ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
63992025-04-30T06:29:55.274ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64002025-04-30T06:29:55.280ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
64012025-04-30T06:29:55.280ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
64022025-04-30T06:29:55.280ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
64032025-04-30T06:29:55.281ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
64042025-04-30T06:29:55.281ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "faab3f74-c8d8-4b67-b121-677e84dbdc24", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64052025-04-30T06:29:55.281ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
64062025-04-30T06:29:55.283ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
64072025-04-30T06:29:55.284ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
64082025-04-30T06:29:55.284ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
64092025-04-30T06:29:55.285ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c05775f7-ba4a-4e91-920f-b06b2c208ece", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64102025-04-30T06:29:55.285ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
64112025-04-30T06:29:55.288ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9153d19-1750-4ef5-aa72-3144e7850044", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64122025-04-30T06:29:55.288ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
64132025-04-30T06:29:55.290ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbefdacb-e157-465e-88b9-f890d6873c87", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64142025-04-30T06:29:55.291ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
64152025-04-30T06:29:55.293ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "05ed705c-afd3-4c98-aee8-d9f7eb970056", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64162025-04-30T06:29:55.293ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
64172025-04-30T06:29:55.294ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "702c6ab9-4efd-4fdc-b089-4b1b6f279b78", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64182025-04-30T06:29:55.294ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
64192025-04-30T06:29:55.295ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5207a259-1582-4e94-950c-2700c06589c0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64202025-04-30T06:29:55.295ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
64212025-04-30T06:29:55.297ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d402e802-a94f-492a-a255-e9baa943cde9", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64222025-04-30T06:29:55.297ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
64232025-04-30T06:29:55.298ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a11119d7-33a5-43e9-9011-565e6a591316", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:54 GMT"} })
64242025-04-30T06:29:55.299ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
64252025-04-30T06:29:55.299ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64262025-04-30T06:29:55.299ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
64272025-04-30T06:29:55.299ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
64282025-04-30T06:29:55.299ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
64292025-04-30T06:29:55.303ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64302025-04-30T06:29:55.310ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
64312025-04-30T06:29:55.310ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
64322025-04-30T06:29:55.310ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64332025-04-30T06:29:55.310ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
64342025-04-30T06:29:55.310ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
64352025-04-30T06:29:55.311ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
64362025-04-30T06:29:55.312ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
64372025-04-30T06:29:55.312ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
64382025-04-30T06:29:55.312ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f5ac3f7d-ae52-4dcf-a63a-5fdae1463131 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
64392025-04-30T06:29:55.313ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f5ac3f7d-ae52-4dcf-a63a-5fdae1463131 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
64402025-04-30T06:29:55.313ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f5ac3f7d-ae52-4dcf-a63a-5fdae1463131 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
64412025-04-30T06:29:55.313ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f5ac3f7d-ae52-4dcf-a63a-5fdae1463131 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
64422025-04-30T06:29:55.320ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64432025-04-30T06:29:55.325ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
64442025-04-30T06:29:55.325ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
64452025-04-30T06:29:55.325ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
64462025-04-30T06:29:55.325ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
64472025-04-30T06:29:55.338ZINFOtest_image_create (dropshot_internal): request completed latency_us = 25174 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f5ac3f7d-ae52-4dcf-a63a-5fdae1463131 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
64482025-04-30T06:29:55.344ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5ac3f7d-ae52-4dcf-a63a-5fdae1463131", "content-length": "405", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
64492025-04-30T06:29:55.345ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
64502025-04-30T06:29:55.442ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
64512025-04-30T06:29:55.442ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
64522025-04-30T06:29:55.447ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
64532025-04-30T06:29:55.447ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:57793 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
64542025-04-30T06:29:55.448ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 0f6a308e-339c-4a94-b6ff-67f977fd1469 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
64552025-04-30T06:29:55.448ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
64562025-04-30T06:29:55.449ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 0f6a308e-339c-4a94-b6ff-67f977fd1469 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
64572025-04-30T06:29:55.449ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 0f6a308e-339c-4a94-b6ff-67f977fd1469 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
64582025-04-30T06:29:55.456ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 0f6a308e-339c-4a94-b6ff-67f977fd1469 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
64592025-04-30T06:29:55.457ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
64602025-04-30T06:29:55.458ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:57793 req_id = 41493345-f5b3-46e9-945c-197513f25ad9 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
64612025-04-30T06:29:55.460ZINFOtest_image_create (dropshot): request completed latency_us = 1801 local_addr = [::1]:42828 method = GET remote_addr = [::1]:57793 req_id = 41493345-f5b3-46e9-945c-197513f25ad9 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
64622025-04-30T06:29:55.461ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
64632025-04-30T06:29:55.462ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
64642025-04-30T06:29:55.462ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
64652025-04-30T06:29:55.462ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
64662025-04-30T06:29:55.462ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "41493345-f5b3-46e9-945c-197513f25ad9", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
64672025-04-30T06:29:55.465ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
64682025-04-30T06:29:55.465ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
64692025-04-30T06:29:55.465ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
64702025-04-30T06:29:55.467ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
64712025-04-30T06:29:55.467ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64722025-04-30T06:29:55.468ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
64732025-04-30T06:29:55.468ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
64742025-04-30T06:29:55.469ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
64752025-04-30T06:29:55.469ZINFOtest_image_create (dropshot_internal): request completed latency_us = 21784 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 0f6a308e-339c-4a94-b6ff-67f977fd1469 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
64762025-04-30T06:29:55.470ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f6a308e-339c-4a94-b6ff-67f977fd1469", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
64772025-04-30T06:29:55.470ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
64782025-04-30T06:29:55.470ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
64792025-04-30T06:29:55.470ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
64802025-04-30T06:29:55.473ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64812025-04-30T06:29:55.481ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
64822025-04-30T06:29:55.481ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
64832025-04-30T06:29:55.481ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
64842025-04-30T06:29:55.482ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
64852025-04-30T06:29:55.499ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
64862025-04-30T06:29:55.500ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64872025-04-30T06:29:55.500ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
64882025-04-30T06:29:55.500ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
64892025-04-30T06:29:55.502ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
64902025-04-30T06:29:55.513ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64912025-04-30T06:29:55.513ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64922025-04-30T06:29:55.516ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
64932025-04-30T06:29:55.517ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
64942025-04-30T06:29:55.517ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64952025-04-30T06:29:55.523ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
64962025-04-30T06:29:55.523ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
64972025-04-30T06:29:55.523ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
64982025-04-30T06:29:55.524ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
64992025-04-30T06:29:55.551ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
65002025-04-30T06:29:55.551ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
65012025-04-30T06:29:55.557ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
65022025-04-30T06:29:55.563ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65032025-04-30T06:29:55.596ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
65042025-04-30T06:29:55.596ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
65052025-04-30T06:29:55.597ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
65062025-04-30T06:29:55.597ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
65072025-04-30T06:29:55.597ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
65082025-04-30T06:29:55.597ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 510.077025ms iteration = 18 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
65092025-04-30T06:29:55.597ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 19 reason = Signaled
65102025-04-30T06:29:55.598ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
65112025-04-30T06:29:55.598ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
65122025-04-30T06:29:55.598ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
65132025-04-30T06:29:55.598ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
65142025-04-30T06:29:55.598ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
65152025-04-30T06:29:55.601ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162025-04-30T06:29:55.612ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
65172025-04-30T06:29:55.612ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
65182025-04-30T06:29:55.612ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
65192025-04-30T06:29:55.612ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
65202025-04-30T06:29:55.616ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
65212025-04-30T06:29:55.618ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
65222025-04-30T06:29:55.618ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
65232025-04-30T06:29:55.620ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: d4 5b 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .[..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:57569 req_id = b30861dc-5eb8-45f6-8471-b65e4eb3cd49
65242025-04-30T06:29:55.620ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 54363,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57569 req_id = b30861dc-5eb8-45f6-8471-b65e4eb3cd49
65252025-04-30T06:29:55.621ZDEBGtest_image_create (store): query key key = _mgs._tcp
65262025-04-30T06:29:55.621ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
65272025-04-30T06:29:55.621ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:57569 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = b30861dc-5eb8-45f6-8471-b65e4eb3cd49
65282025-04-30T06:29:55.621ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3460, tv_nsec: 420779602 } })
65292025-04-30T06:29:55.622ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
65302025-04-30T06:29:55.622ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 50 b8 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e P...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:55783 req_id = 300d55c1-d2d6-47c5-baf8-890b3d788926
65312025-04-30T06:29:55.622ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 20664,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55783 req_id = 300d55c1-d2d6-47c5-baf8-890b3d788926
65322025-04-30T06:29:55.623ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
65332025-04-30T06:29:55.623ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:55783 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 300d55c1-d2d6-47c5-baf8-890b3d788926
65342025-04-30T06:29:55.741ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
65352025-04-30T06:29:55.742ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: f4 36 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .6..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:57264 req_id = 3cebb047-7b3a-4f85-a83e-84bb588a44b2
65362025-04-30T06:29:55.744ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62518,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57264 req_id = 3cebb047-7b3a-4f85-a83e-84bb588a44b2
65372025-04-30T06:29:55.744ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
65382025-04-30T06:29:55.745ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62518, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:57264 req_id = 3cebb047-7b3a-4f85-a83e-84bb588a44b2
65392025-04-30T06:29:55.745ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
65402025-04-30T06:29:55.745ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
65412025-04-30T06:29:55.745ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
65422025-04-30T06:29:55.748ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "24afdb65-d902-4139-8633-fe78b9a487c1", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65432025-04-30T06:29:55.748ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
65442025-04-30T06:29:55.750ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "952b20a8-e08b-44f5-8ae4-f683cd94a1e1", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65452025-04-30T06:29:55.750ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
65462025-04-30T06:29:55.753ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c5414b8-b490-41cd-a6ec-b1e648d27836", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65472025-04-30T06:29:55.753ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
65482025-04-30T06:29:55.757ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1098a54-57c8-442f-9166-01285e8d6e60", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65492025-04-30T06:29:55.757ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
65502025-04-30T06:29:55.762ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
65512025-04-30T06:29:55.776ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbe29ef3-eb8a-4637-a038-6e9ea9adde39", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65522025-04-30T06:29:55.776ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
65532025-04-30T06:29:55.782ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7061ea6-db88-4200-a9e7-0ee7d1701a87", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65542025-04-30T06:29:55.782ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
65552025-04-30T06:29:55.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "773afe14-3ac6-47d5-8c0b-f729a46175db", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65562025-04-30T06:29:55.786ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
65572025-04-30T06:29:55.789ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "75fe4747-b954-4547-98b4-a39077fd840a", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65582025-04-30T06:29:55.790ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
65592025-04-30T06:29:55.791ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aeef10e-2f0e-4d0d-ad64-8dc4f5d2d07c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65602025-04-30T06:29:55.792ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
65612025-04-30T06:29:55.793ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3473bf47-98e0-4d26-aa55-90fc462d1819", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65622025-04-30T06:29:55.793ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
65632025-04-30T06:29:55.795ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eedbb44f-8a6c-4578-9850-18a762131199", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65642025-04-30T06:29:55.795ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
65652025-04-30T06:29:55.798ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "14da54dd-87aa-4d7e-8aa2-63dcab25a1c8", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65662025-04-30T06:29:55.798ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
65672025-04-30T06:29:55.800ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b264be49-a7b2-4eaf-8648-28b847a5d4e6", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65682025-04-30T06:29:55.800ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
65692025-04-30T06:29:55.802ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "20831d5b-aaf6-421a-9579-57d7ff86fa55", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65702025-04-30T06:29:55.803ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
65712025-04-30T06:29:55.806ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d523e0fc-4142-44ca-b790-42850839eb5d", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65722025-04-30T06:29:55.806ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
65732025-04-30T06:29:55.811ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9facf6d3-8a68-4bab-83fc-9fb896ee392b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65742025-04-30T06:29:55.811ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
65752025-04-30T06:29:55.814ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
65762025-04-30T06:29:55.814ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
65772025-04-30T06:29:55.814ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
65782025-04-30T06:29:55.814ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
65792025-04-30T06:29:55.816ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
65802025-04-30T06:29:55.819ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65812025-04-30T06:29:55.824ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
65822025-04-30T06:29:55.824ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
65832025-04-30T06:29:55.824ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
65842025-04-30T06:29:55.825ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
65852025-04-30T06:29:55.826ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d73ce55d-acc0-44d0-aaf4-c722fff26865", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65862025-04-30T06:29:55.827ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
65872025-04-30T06:29:55.827ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
65882025-04-30T06:29:55.827ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
65892025-04-30T06:29:55.829ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
65902025-04-30T06:29:55.837ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b665c38b-e95c-4b6f-8a53-465eadef7c0d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65912025-04-30T06:29:55.837ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
65922025-04-30T06:29:55.842ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "667ff3e3-8952-468b-a67a-c3dc2dcac9de", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65932025-04-30T06:29:55.842ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
65942025-04-30T06:29:55.844ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e2af2f2-76ba-40b7-b09f-977a812fa127", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65952025-04-30T06:29:55.844ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
65962025-04-30T06:29:55.845ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "375f07d4-e8b5-4775-861c-4c6b28355477", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65972025-04-30T06:29:55.846ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
65982025-04-30T06:29:55.847ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0f17633-da44-4b52-a573-8d5e899db022", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
65992025-04-30T06:29:55.847ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
66002025-04-30T06:29:55.848ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f1828ec-f06c-46cd-9064-7ad5351314c5", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66012025-04-30T06:29:55.848ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
66022025-04-30T06:29:55.849ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a0dfe7b-81a6-4f1a-8f97-bf00590de313", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66032025-04-30T06:29:55.850ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
66042025-04-30T06:29:55.851ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "889ea367-e5ba-4e2b-b077-f037d4ce0ceb", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66052025-04-30T06:29:55.852ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
66062025-04-30T06:29:55.854ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d570341-7355-410d-abd9-4f9ad939605a", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66072025-04-30T06:29:55.854ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
66082025-04-30T06:29:55.868ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
66092025-04-30T06:29:55.870ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb54b7ac-628d-40dc-b405-0ef35d67611e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66102025-04-30T06:29:55.871ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
66112025-04-30T06:29:55.872ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "62623840-3dba-412b-a6db-c106b9214527", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66122025-04-30T06:29:55.873ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
66132025-04-30T06:29:55.874ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3ffbc9b-c044-49f1-9745-2d4cc4a2df96", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66142025-04-30T06:29:55.875ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
66152025-04-30T06:29:55.877ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "00903e35-fac9-4d93-9e22-416e96501bad", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66162025-04-30T06:29:55.879ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
66172025-04-30T06:29:55.881ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9706e54e-da00-4e0b-a2cf-59d5eb4e5979", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66182025-04-30T06:29:55.881ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
66192025-04-30T06:29:55.882ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e193e44e-2817-46c9-8b91-4b7f3bd9ab4d", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66202025-04-30T06:29:55.882ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
66212025-04-30T06:29:55.884ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6512d5a4-6aa6-473a-a808-e83632a97161", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66222025-04-30T06:29:55.884ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
66232025-04-30T06:29:55.885ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cce8057-c5f3-4edf-9625-25af292fbab5", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66242025-04-30T06:29:55.885ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
66252025-04-30T06:29:55.887ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9f11505-124c-4714-b1b5-7fb125c2afa5", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66262025-04-30T06:29:55.887ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
66272025-04-30T06:29:55.889ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "326e30cb-b128-4d97-8e9d-538ae39bd5de", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66282025-04-30T06:29:55.889ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
66292025-04-30T06:29:55.891ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "040a1d45-25f0-494c-818d-52eea6a9ac86", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66302025-04-30T06:29:55.891ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
66312025-04-30T06:29:55.893ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0d9c715-b3ee-4558-bc19-d6bc75eecf56", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66322025-04-30T06:29:55.894ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
66332025-04-30T06:29:55.902ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f501ada-56b8-4c4f-b036-4778ba807b30", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66342025-04-30T06:29:55.902ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
66352025-04-30T06:29:55.907ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "028ea088-46c0-4886-bc30-cbcf9b057de4", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66362025-04-30T06:29:55.907ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
66372025-04-30T06:29:55.910ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cbac693-67cd-4103-b604-3731ba66c679", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66382025-04-30T06:29:55.910ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
66392025-04-30T06:29:55.911ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "631f74aa-5da9-4099-92e9-7baf23933220", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66402025-04-30T06:29:55.911ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
66412025-04-30T06:29:55.913ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "daa1bc76-c75d-47a2-9fd9-51dbf3da4da4", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66422025-04-30T06:29:55.913ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
66432025-04-30T06:29:55.916ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2425252d-cad9-43cd-b685-3fcf02e9de88", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66442025-04-30T06:29:55.917ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
66452025-04-30T06:29:55.918ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8427351b-2033-47fe-87a1-1e735184ae5d", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66462025-04-30T06:29:55.918ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
66472025-04-30T06:29:55.919ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66482025-04-30T06:29:55.919ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
66492025-04-30T06:29:55.919ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66502025-04-30T06:29:55.920ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66512025-04-30T06:29:55.920ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
66522025-04-30T06:29:55.920ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66532025-04-30T06:29:55.920ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
66542025-04-30T06:29:55.920ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
66552025-04-30T06:29:55.921ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
66562025-04-30T06:29:55.923ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66572025-04-30T06:29:55.932ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
66582025-04-30T06:29:55.933ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
66592025-04-30T06:29:55.933ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66602025-04-30T06:29:55.933ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
66612025-04-30T06:29:55.933ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66622025-04-30T06:29:55.934ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66632025-04-30T06:29:55.937ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66642025-04-30T06:29:55.945ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
66652025-04-30T06:29:55.945ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
66662025-04-30T06:29:55.946ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
66672025-04-30T06:29:55.946ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
66682025-04-30T06:29:55.949ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66692025-04-30T06:29:55.956ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
66702025-04-30T06:29:55.956ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
66712025-04-30T06:29:55.956ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66722025-04-30T06:29:55.956ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66732025-04-30T06:29:55.965ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
66742025-04-30T06:29:55.966ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
66752025-04-30T06:29:55.966ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
66762025-04-30T06:29:56.032ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
66772025-04-30T06:29:56.032ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
66782025-04-30T06:29:56.035ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:53684 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
66792025-04-30T06:29:56.035ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:53684 req_id = 9a4a2769-678b-4e71-b822-da3d9b4da01a sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
66802025-04-30T06:29:56.043ZINFOtest_image_create (dropshot): request completed latency_us = 7490 local_addr = [::1]:42828 method = GET remote_addr = [::1]:53684 req_id = 9a4a2769-678b-4e71-b822-da3d9b4da01a response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
66812025-04-30T06:29:56.044ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a4a2769-678b-4e71-b822-da3d9b4da01a", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
66822025-04-30T06:29:56.045ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
66832025-04-30T06:29:56.045ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
66842025-04-30T06:29:56.045ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
66852025-04-30T06:29:56.047ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
66862025-04-30T06:29:56.047ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66872025-04-30T06:29:56.047ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
66882025-04-30T06:29:56.047ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66892025-04-30T06:29:56.048ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66902025-04-30T06:29:56.051ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66912025-04-30T06:29:56.058ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
66922025-04-30T06:29:56.058ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
66932025-04-30T06:29:56.058ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66942025-04-30T06:29:56.059ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66952025-04-30T06:29:56.095ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
66962025-04-30T06:29:56.101ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
66972025-04-30T06:29:56.101ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
66982025-04-30T06:29:56.101ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 503.924306ms iteration = 19 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
66992025-04-30T06:29:56.102ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 20 reason = Signaled
67002025-04-30T06:29:56.102ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
67012025-04-30T06:29:56.102ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67022025-04-30T06:29:56.102ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
67032025-04-30T06:29:56.102ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67042025-04-30T06:29:56.104ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
67052025-04-30T06:29:56.107ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67062025-04-30T06:29:56.113ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
67072025-04-30T06:29:56.113ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
67082025-04-30T06:29:56.113ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67092025-04-30T06:29:56.114ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
67102025-04-30T06:29:56.117ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
67112025-04-30T06:29:56.117ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
67122025-04-30T06:29:56.118ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: b7 f5 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:60132 req_id = 89d42c78-ed4d-456d-a4a2-e6cb15849c40
67132025-04-30T06:29:56.119ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 47093,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60132 req_id = 89d42c78-ed4d-456d-a4a2-e6cb15849c40
67142025-04-30T06:29:56.119ZDEBGtest_image_create (store): query key key = _mgs._tcp
67152025-04-30T06:29:56.119ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
67162025-04-30T06:29:56.120ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:60132 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 89d42c78-ed4d-456d-a4a2-e6cb15849c40
67172025-04-30T06:29:56.120ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3460, tv_nsec: 919285252 } })
67182025-04-30T06:29:56.120ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
67192025-04-30T06:29:56.120ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 71 fc 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e q...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:59966 req_id = 0e869de8-f968-44b6-8c23-8913a2e5a671
67202025-04-30T06:29:56.121ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 29180,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59966 req_id = 0e869de8-f968-44b6-8c23-8913a2e5a671
67212025-04-30T06:29:56.121ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
67222025-04-30T06:29:56.121ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59966 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 0e869de8-f968-44b6-8c23-8913a2e5a671
67232025-04-30T06:29:56.213ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
67242025-04-30T06:29:56.214ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
67252025-04-30T06:29:56.214ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67262025-04-30T06:29:56.214ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
67272025-04-30T06:29:56.214ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
67282025-04-30T06:29:56.215ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
67292025-04-30T06:29:56.216ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 2b 58 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c +X..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:62136 req_id = 06a4ce3a-4b07-4a98-b9c0-83c3041de7cf
67302025-04-30T06:29:56.216ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 11096,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62136 req_id = 06a4ce3a-4b07-4a98-b9c0-83c3041de7cf
67312025-04-30T06:29:56.216ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
67322025-04-30T06:29:56.217ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11096, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:62136 req_id = 06a4ce3a-4b07-4a98-b9c0-83c3041de7cf
67332025-04-30T06:29:56.217ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
67342025-04-30T06:29:56.217ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
67352025-04-30T06:29:56.218ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
67362025-04-30T06:29:56.222ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67372025-04-30T06:29:56.241ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
67382025-04-30T06:29:56.241ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
67392025-04-30T06:29:56.241ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
67402025-04-30T06:29:56.242ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
67412025-04-30T06:29:56.242ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "e61d69c3-f5cc-4b32-8a8c-b3befbfe0680", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67422025-04-30T06:29:56.242ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
67432025-04-30T06:29:56.247ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
67442025-04-30T06:29:56.247ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
67452025-04-30T06:29:56.247ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
67462025-04-30T06:29:56.250ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dae87461-9405-46a9-8789-60322268635c", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67472025-04-30T06:29:56.250ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
67482025-04-30T06:29:56.256ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f1664ff-c1cd-49f6-8e5e-2cb55eab8640", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67492025-04-30T06:29:56.256ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
67502025-04-30T06:29:56.260ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e6dbcaf-4af9-487d-bb1e-2485a9d7231f", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67512025-04-30T06:29:56.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
67522025-04-30T06:29:56.270ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c81b4cae-8f67-457e-8e88-f4f56f33dd4b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67532025-04-30T06:29:56.271ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
67542025-04-30T06:29:56.315ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa0c6e9d-ec7c-4e1f-b40a-79fadb222988", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67552025-04-30T06:29:56.315ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
67562025-04-30T06:29:56.322ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
67572025-04-30T06:29:56.326ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2156ad9-2e53-4003-8382-1588a0aff9ab", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67582025-04-30T06:29:56.326ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
67592025-04-30T06:29:56.329ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc71be42-291a-4c71-b7e0-fd5782e834ae", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67602025-04-30T06:29:56.329ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
67612025-04-30T06:29:56.330ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d473b37-0cda-4a55-9c6c-37857d661319", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67622025-04-30T06:29:56.330ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
67632025-04-30T06:29:56.331ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "351c522c-6e84-4762-aea3-6c75740e5dc9", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67642025-04-30T06:29:56.331ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
67652025-04-30T06:29:56.332ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a0987ae-f907-49e7-8554-637f9f75c199", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67662025-04-30T06:29:56.332ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
67672025-04-30T06:29:56.333ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24484eab-515a-4abe-bf8a-3ff5fd14212b", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67682025-04-30T06:29:56.333ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
67692025-04-30T06:29:56.336ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ae32548-8292-42a9-bc09-79b28c918e3b", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:55 GMT"} })
67702025-04-30T06:29:56.336ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
67712025-04-30T06:29:56.339ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c5d31f3-5678-48dc-9635-bccb5d1253a7", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67722025-04-30T06:29:56.339ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
67732025-04-30T06:29:56.341ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "68bf8059-7a11-4667-9e62-1085c62e3f2c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67742025-04-30T06:29:56.341ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
67752025-04-30T06:29:56.343ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2823d40-cf4b-4e3f-be2c-867c28b14a03", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67762025-04-30T06:29:56.343ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
67772025-04-30T06:29:56.348ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "78e47fc9-7544-4ace-8c62-a84c4344969c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67782025-04-30T06:29:56.348ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
67792025-04-30T06:29:56.350ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "00047ea0-e5af-4803-a301-d5c38f15fadb", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67802025-04-30T06:29:56.350ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
67812025-04-30T06:29:56.352ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c241c81-2706-4e19-8a0c-8f9f43a681fa", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67822025-04-30T06:29:56.352ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
67832025-04-30T06:29:56.353ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "96c09b6e-5738-4de8-855b-425696d78e85", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67842025-04-30T06:29:56.353ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
67852025-04-30T06:29:56.355ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "09507017-c05c-49fe-8086-1ec3848c8739", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67862025-04-30T06:29:56.355ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
67872025-04-30T06:29:56.358ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b21e0018-855e-4bc5-a573-b50061f151b7", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67882025-04-30T06:29:56.359ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
67892025-04-30T06:29:56.360ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fda4114-dd56-4487-97ee-8314bd164cbc", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67902025-04-30T06:29:56.360ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
67912025-04-30T06:29:56.361ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "de0704ee-9583-45df-9b73-da2019c401e5", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67922025-04-30T06:29:56.361ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
67932025-04-30T06:29:56.369ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bedb4c3-ed0f-4f65-b4cc-6f58e750fec4", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
67942025-04-30T06:29:56.369ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
67952025-04-30T06:29:56.373ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
67962025-04-30T06:29:56.373ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67972025-04-30T06:29:56.373ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
67982025-04-30T06:29:56.374ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
67992025-04-30T06:29:56.375ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
68002025-04-30T06:29:56.376ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "48dddb13-2fed-40d0-9aeb-87923efefeeb", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68012025-04-30T06:29:56.376ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
68022025-04-30T06:29:56.377ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68032025-04-30T06:29:56.384ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
68042025-04-30T06:29:56.384ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
68052025-04-30T06:29:56.384ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
68062025-04-30T06:29:56.384ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
68072025-04-30T06:29:56.396ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
68082025-04-30T06:29:56.396ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
68092025-04-30T06:29:56.397ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
68102025-04-30T06:29:56.401ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e985106-7a0b-4827-a668-4e55f393953f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68112025-04-30T06:29:56.401ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
68122025-04-30T06:29:56.408ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "715d9495-89d4-44ab-aa8b-9267e86c9e0f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68132025-04-30T06:29:56.408ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
68142025-04-30T06:29:56.418ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4afe76ed-a4c4-404d-9ae0-452d7dd4a031", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68152025-04-30T06:29:56.418ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
68162025-04-30T06:29:56.420ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
68172025-04-30T06:29:56.421ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
68182025-04-30T06:29:56.423ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
68192025-04-30T06:29:56.424ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
68202025-04-30T06:29:56.424ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
68212025-04-30T06:29:56.424ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
68222025-04-30T06:29:56.426ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb732728-85dc-435b-ba4d-5e72014f135d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68232025-04-30T06:29:56.426ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
68242025-04-30T06:29:56.427ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bae74ae7-06c7-42a2-83f8-a59f35f98bb0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68252025-04-30T06:29:56.427ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
68262025-04-30T06:29:56.428ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d34fbe67-ddfc-4255-aea4-1ead51c5fff8", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68272025-04-30T06:29:56.428ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
68282025-04-30T06:29:56.429ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5af3e0cc-9f25-4816-99ee-3cd4b27d8929", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68292025-04-30T06:29:56.429ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
68302025-04-30T06:29:56.430ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "64f077d3-1aff-420d-aa98-ac1ff8dd00cf", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68312025-04-30T06:29:56.430ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
68322025-04-30T06:29:56.432ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0de4e49-78dc-4083-a968-48c63ba03fac", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68332025-04-30T06:29:56.432ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
68342025-04-30T06:29:56.435ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5130a80-2c61-457f-8d22-16616d220e1b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68352025-04-30T06:29:56.435ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
68362025-04-30T06:29:56.438ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "feae7c44-79de-46d5-b40b-ac7d7866fd58", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68372025-04-30T06:29:56.438ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
68382025-04-30T06:29:56.441ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e7fe1e5-ba2a-4916-9b7e-3053fe726b09", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68392025-04-30T06:29:56.441ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
68402025-04-30T06:29:56.453ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
68412025-04-30T06:29:56.455ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf7dac2b-5341-4d5b-aae6-6e9563f22e47", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68422025-04-30T06:29:56.456ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
68432025-04-30T06:29:56.464ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "453e2eae-1c31-4a74-bd84-6288c433da88", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68442025-04-30T06:29:56.465ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
68452025-04-30T06:29:56.467ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eb72d94-6e8f-4eab-a23e-ac0f2f8e1351", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68462025-04-30T06:29:56.467ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
68472025-04-30T06:29:56.469ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9897e5e0-2b34-42f5-ac0d-53ba00d48d94", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68482025-04-30T06:29:56.469ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
68492025-04-30T06:29:56.470ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "59c316c2-a3c1-4a3e-86be-fa132caafd8a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68502025-04-30T06:29:56.471ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
68512025-04-30T06:29:56.472ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "01440136-c7b8-4e41-a191-25cbc70a8d4f", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68522025-04-30T06:29:56.472ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
68532025-04-30T06:29:56.473ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3107655-4bea-4d89-9dd9-5dd75e41c5e3", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68542025-04-30T06:29:56.473ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
68552025-04-30T06:29:56.473ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68562025-04-30T06:29:56.473ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
68572025-04-30T06:29:56.473ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
68582025-04-30T06:29:56.475ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
68592025-04-30T06:29:56.481ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68602025-04-30T06:29:56.487ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
68612025-04-30T06:29:56.488ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
68622025-04-30T06:29:56.488ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68632025-04-30T06:29:56.488ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
68642025-04-30T06:29:56.488ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
68652025-04-30T06:29:56.489ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
68662025-04-30T06:29:56.493ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68672025-04-30T06:29:56.500ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
68682025-04-30T06:29:56.500ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
68692025-04-30T06:29:56.500ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
68702025-04-30T06:29:56.501ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
68712025-04-30T06:29:56.505ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
68722025-04-30T06:29:56.505ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68732025-04-30T06:29:56.506ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
68742025-04-30T06:29:56.506ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
68752025-04-30T06:29:56.506ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
68762025-04-30T06:29:56.599ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
68772025-04-30T06:29:56.599ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
68782025-04-30T06:29:56.600ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68792025-04-30T06:29:56.606ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
68802025-04-30T06:29:56.607ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
68812025-04-30T06:29:56.607ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
68822025-04-30T06:29:56.610ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
68832025-04-30T06:29:56.610ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:35034 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
68842025-04-30T06:29:56.611ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68852025-04-30T06:29:56.611ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68862025-04-30T06:29:56.611ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
68872025-04-30T06:29:56.613ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
68882025-04-30T06:29:56.614ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:35034 req_id = 8466f21f-9401-45b8-bee0-7334140f6641 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
68892025-04-30T06:29:56.619ZINFOtest_image_create (dropshot): request completed latency_us = 5476 local_addr = [::1]:42828 method = GET remote_addr = [::1]:35034 req_id = 8466f21f-9401-45b8-bee0-7334140f6641 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
68902025-04-30T06:29:56.619ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
68912025-04-30T06:29:56.619ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
68922025-04-30T06:29:56.620ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
68932025-04-30T06:29:56.621ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8466f21f-9401-45b8-bee0-7334140f6641", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
68942025-04-30T06:29:56.623ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
68952025-04-30T06:29:56.623ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
68962025-04-30T06:29:56.623ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
68972025-04-30T06:29:56.624ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
68982025-04-30T06:29:56.625ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68992025-04-30T06:29:56.625ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
69002025-04-30T06:29:56.625ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69012025-04-30T06:29:56.625ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69022025-04-30T06:29:56.626ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
69032025-04-30T06:29:56.626ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
69042025-04-30T06:29:56.632ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69052025-04-30T06:29:56.636ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
69062025-04-30T06:29:56.637ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
69072025-04-30T06:29:56.637ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69082025-04-30T06:29:56.637ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69092025-04-30T06:29:56.638ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
69102025-04-30T06:29:56.638ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
69112025-04-30T06:29:56.717ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
69122025-04-30T06:29:56.796ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
69132025-04-30T06:29:56.797ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
69142025-04-30T06:29:56.797ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
69152025-04-30T06:29:56.797ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 695.723934ms iteration = 20 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
69162025-04-30T06:29:56.797ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 21 reason = Signaled
69172025-04-30T06:29:56.797ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
69182025-04-30T06:29:56.797ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
69192025-04-30T06:29:56.797ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
69202025-04-30T06:29:56.797ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69212025-04-30T06:29:56.798ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69222025-04-30T06:29:56.801ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69232025-04-30T06:29:56.808ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
69242025-04-30T06:29:56.808ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
69252025-04-30T06:29:56.808ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69262025-04-30T06:29:56.809ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69272025-04-30T06:29:56.812ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
69282025-04-30T06:29:56.812ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
69292025-04-30T06:29:56.814ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: c5 60 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .`..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:52307 req_id = 21f88195-5f06-4d40-b54a-d601bc76768d
69302025-04-30T06:29:56.814ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 50528,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52307 req_id = 21f88195-5f06-4d40-b54a-d601bc76768d
69312025-04-30T06:29:56.814ZDEBGtest_image_create (store): query key key = _mgs._tcp
69322025-04-30T06:29:56.815ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
69332025-04-30T06:29:56.815ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:52307 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 21f88195-5f06-4d40-b54a-d601bc76768d
69342025-04-30T06:29:56.816ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3461, tv_nsec: 614754288 } })
69352025-04-30T06:29:56.816ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
69362025-04-30T06:29:56.816ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 89 2a 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .*..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:54387 req_id = ae988643-7676-4353-b65e-7b572ead80a4
69372025-04-30T06:29:56.817ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 35114,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54387 req_id = ae988643-7676-4353-b65e-7b572ead80a4
69382025-04-30T06:29:56.817ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
69392025-04-30T06:29:56.817ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:54387 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = ae988643-7676-4353-b65e-7b572ead80a4
69402025-04-30T06:29:56.890ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
69412025-04-30T06:29:56.891ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
69422025-04-30T06:29:56.891ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
69432025-04-30T06:29:56.891ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
69442025-04-30T06:29:56.891ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
69452025-04-30T06:29:56.891ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
69462025-04-30T06:29:56.892ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: fd 37 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .7..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:59970 req_id = f073b6e3-f805-4ffc-8be0-c71ee92f0c6c
69472025-04-30T06:29:56.893ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64823,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59970 req_id = f073b6e3-f805-4ffc-8be0-c71ee92f0c6c
69482025-04-30T06:29:56.893ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
69492025-04-30T06:29:56.893ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64823, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59970 req_id = f073b6e3-f805-4ffc-8be0-c71ee92f0c6c
69502025-04-30T06:29:56.894ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
69512025-04-30T06:29:56.894ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
69522025-04-30T06:29:56.894ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
69532025-04-30T06:29:56.898ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69542025-04-30T06:29:56.912ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
69552025-04-30T06:29:56.912ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
69562025-04-30T06:29:56.912ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
69572025-04-30T06:29:56.913ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
69582025-04-30T06:29:56.917ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "83e25d89-9524-4863-a611-b75f1da4f6d5", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69592025-04-30T06:29:56.918ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
69602025-04-30T06:29:56.919ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
69612025-04-30T06:29:56.919ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
69622025-04-30T06:29:56.920ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
69632025-04-30T06:29:56.923ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7183e441-7c5a-4019-b65b-83b437930c00", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69642025-04-30T06:29:56.924ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
69652025-04-30T06:29:56.931ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "74daa81a-4476-4c34-a874-7d2ab16ced90", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69662025-04-30T06:29:56.931ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
69672025-04-30T06:29:56.939ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "de9dea9c-4b11-4ca1-835e-cf79f28efafd", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69682025-04-30T06:29:56.939ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
69692025-04-30T06:29:56.946ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dafc8d2b-be6c-44ca-b801-cba8eb3438c1", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69702025-04-30T06:29:56.946ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
69712025-04-30T06:29:56.966ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "33bd3b1c-1100-4f16-9faa-4ce190282a70", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69722025-04-30T06:29:56.966ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
69732025-04-30T06:29:56.967ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
69742025-04-30T06:29:56.971ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "43f614e1-0431-4824-b269-1036085997df", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69752025-04-30T06:29:56.971ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
69762025-04-30T06:29:56.977ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "653f5f24-32a7-4330-8643-e60b6e4f9c29", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69772025-04-30T06:29:56.977ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
69782025-04-30T06:29:56.979ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eff02d8e-1d43-453c-885f-399c96beb9b0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69792025-04-30T06:29:56.979ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
69802025-04-30T06:29:56.980ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f6d2960-bd6c-42c9-84c6-102d8f1a626f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69812025-04-30T06:29:56.981ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
69822025-04-30T06:29:56.982ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d5ec659-da5a-4001-ad0e-60b5af133ca0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69832025-04-30T06:29:56.982ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
69842025-04-30T06:29:56.984ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea49fa0a-10c3-41d7-b088-a645a482aa13", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69852025-04-30T06:29:56.985ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
69862025-04-30T06:29:56.987ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c23e982-8521-48f5-a237-8baffa6c6244", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69872025-04-30T06:29:56.987ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
69882025-04-30T06:29:56.989ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "23da1c63-f227-4d11-95af-16aaafad8342", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69892025-04-30T06:29:56.989ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
69902025-04-30T06:29:56.994ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a5fd7c2-7a34-48e7-bfea-1849b5ca1dfc", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69912025-04-30T06:29:56.994ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
69922025-04-30T06:29:56.997ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "370146d2-c4dd-40f2-a069-c79e7ad0124c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69932025-04-30T06:29:56.998ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
69942025-04-30T06:29:57.002ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2dc2f15-3aeb-470c-9933-839a199db2b0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69952025-04-30T06:29:57.002ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
69962025-04-30T06:29:57.004ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d60c0ca-a93c-4da2-bfc9-f3f9038efdc4", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69972025-04-30T06:29:57.004ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
69982025-04-30T06:29:57.010ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb095c95-5656-4cf5-900b-6c51fc48531a", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
69992025-04-30T06:29:57.011ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
70002025-04-30T06:29:57.012ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ac083a4-1fdd-4138-9307-6818a0bdb6e2", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70012025-04-30T06:29:57.013ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
70022025-04-30T06:29:57.014ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e28df4e-b512-4726-8945-dfc9d0519a7d", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70032025-04-30T06:29:57.014ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
70042025-04-30T06:29:57.015ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ec7728a-1799-409e-8262-f605cfd5fb71", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70052025-04-30T06:29:57.015ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
70062025-04-30T06:29:57.016ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bc7236f-56a4-49e8-ad5b-0d616a5c3455", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70072025-04-30T06:29:57.016ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
70082025-04-30T06:29:57.018ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aca690e-adb3-4a28-ad49-2b2f0e5234e0", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70092025-04-30T06:29:57.018ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
70102025-04-30T06:29:57.018ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
70112025-04-30T06:29:57.018ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
70122025-04-30T06:29:57.018ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
70132025-04-30T06:29:57.018ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
70142025-04-30T06:29:57.019ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
70152025-04-30T06:29:57.022ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d020b1f3-0ae5-4a61-ba3f-e0ff0ea0b9d3", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70162025-04-30T06:29:57.022ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
70172025-04-30T06:29:57.022ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70182025-04-30T06:29:57.050ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
70192025-04-30T06:29:57.050ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
70202025-04-30T06:29:57.050ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
70212025-04-30T06:29:57.051ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
70222025-04-30T06:29:57.065ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
70232025-04-30T06:29:57.065ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
70242025-04-30T06:29:57.066ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
70252025-04-30T06:29:57.066ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "77c843e1-6b6c-4ebc-bfa4-1a8796d6f37f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70262025-04-30T06:29:57.067ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
70272025-04-30T06:29:57.071ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "45e59e08-aeb5-4fa0-bd00-9b6ed2d92b22", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70282025-04-30T06:29:57.071ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
70292025-04-30T06:29:57.075ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6af50c9-5335-451b-ac3b-4b84b9f144f2", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70302025-04-30T06:29:57.075ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
70312025-04-30T06:29:57.085ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0436cb53-97b0-441a-b57b-c7ebd5856828", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70322025-04-30T06:29:57.085ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
70332025-04-30T06:29:57.091ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa6dbb73-dc03-469c-ba67-dec7d7059b5a", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70342025-04-30T06:29:57.091ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
70352025-04-30T06:29:57.094ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "06ef2d32-0341-451a-892c-0fc46273d05f", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70362025-04-30T06:29:57.095ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
70372025-04-30T06:29:57.101ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd38c6ec-e62d-430e-91cb-d344f7aa79ae", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70382025-04-30T06:29:57.101ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
70392025-04-30T06:29:57.102ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "36be46ba-add8-48f1-8be6-55d9bac45bd5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70402025-04-30T06:29:57.102ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
70412025-04-30T06:29:57.103ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c43875f-156a-42ca-a4b8-f4bf9b744a88", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70422025-04-30T06:29:57.104ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
70432025-04-30T06:29:57.108ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7307cca-ba20-41ee-ae53-d5aa75690412", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70442025-04-30T06:29:57.109ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
70452025-04-30T06:29:57.109ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
70462025-04-30T06:29:57.113ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c686e3a-4e52-4880-84c6-4adc8b579075", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70472025-04-30T06:29:57.113ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
70482025-04-30T06:29:57.115ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "551b0531-24ee-4973-8983-29047bc3b063", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70492025-04-30T06:29:57.115ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
70502025-04-30T06:29:57.116ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfcb3f73-e3c5-49ff-9d8d-690a499cfd10", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70512025-04-30T06:29:57.117ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
70522025-04-30T06:29:57.121ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "32325fea-cd23-444d-8e0d-4d4c62cbb6a8", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70532025-04-30T06:29:57.121ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
70542025-04-30T06:29:57.122ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d8fdf60-8bcb-41f3-9ad5-0651c4a4e410", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70552025-04-30T06:29:57.122ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
70562025-04-30T06:29:57.124ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d07f772e-52df-4ff7-9b22-8b9d15f398ea", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70572025-04-30T06:29:57.124ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
70582025-04-30T06:29:57.125ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "579adda8-a103-4c36-9fd8-c37606c061ee", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70592025-04-30T06:29:57.126ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
70602025-04-30T06:29:57.127ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eeb06f2-511c-46a4-a435-cdcf570146d7", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70612025-04-30T06:29:57.127ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
70622025-04-30T06:29:57.128ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f6c9f13-a2fb-4bfb-8aa7-14d59a4114dc", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70632025-04-30T06:29:57.128ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
70642025-04-30T06:29:57.129ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e35cc178-9860-4ee7-af34-d66e0388cc7b", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
70652025-04-30T06:29:57.129ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
70662025-04-30T06:29:57.129ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
70672025-04-30T06:29:57.129ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
70682025-04-30T06:29:57.129ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70692025-04-30T06:29:57.130ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70702025-04-30T06:29:57.135ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712025-04-30T06:29:57.142ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
70722025-04-30T06:29:57.142ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
70732025-04-30T06:29:57.142ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
70742025-04-30T06:29:57.143ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
70752025-04-30T06:29:57.143ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70762025-04-30T06:29:57.144ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70772025-04-30T06:29:57.148ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70782025-04-30T06:29:57.155ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
70792025-04-30T06:29:57.155ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
70802025-04-30T06:29:57.156ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70812025-04-30T06:29:57.158ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70822025-04-30T06:29:57.160ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
70832025-04-30T06:29:57.160ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
70842025-04-30T06:29:57.160ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
70852025-04-30T06:29:57.160ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
70862025-04-30T06:29:57.160ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
70872025-04-30T06:29:57.246ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
70882025-04-30T06:29:57.246ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
70892025-04-30T06:29:57.247ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70902025-04-30T06:29:57.255ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
70912025-04-30T06:29:57.255ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
70922025-04-30T06:29:57.255ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
70932025-04-30T06:29:57.255ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
70942025-04-30T06:29:57.255ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:55247 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
70952025-04-30T06:29:57.260ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:55247 req_id = 919b614f-ee77-44db-a201-8bd403c81fde sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
70962025-04-30T06:29:57.261ZINFOtest_image_create (dropshot): request completed latency_us = 1188 local_addr = [::1]:42828 method = GET remote_addr = [::1]:55247 req_id = 919b614f-ee77-44db-a201-8bd403c81fde response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
70972025-04-30T06:29:57.262ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
70982025-04-30T06:29:57.262ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
70992025-04-30T06:29:57.263ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
71002025-04-30T06:29:57.264ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "919b614f-ee77-44db-a201-8bd403c81fde", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
71012025-04-30T06:29:57.270ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
71022025-04-30T06:29:57.270ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
71032025-04-30T06:29:57.270ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
71042025-04-30T06:29:57.273ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
71052025-04-30T06:29:57.273ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
71062025-04-30T06:29:57.273ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
71072025-04-30T06:29:57.273ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71082025-04-30T06:29:57.274ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71092025-04-30T06:29:57.284ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71102025-04-30T06:29:57.294ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
71112025-04-30T06:29:57.294ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
71122025-04-30T06:29:57.294ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71132025-04-30T06:29:57.295ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71142025-04-30T06:29:57.306ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
71152025-04-30T06:29:57.306ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
71162025-04-30T06:29:57.307ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5812426d-c5be-463d-b47d-4531274fa390 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
71172025-04-30T06:29:57.307ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5812426d-c5be-463d-b47d-4531274fa390 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
71182025-04-30T06:29:57.307ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5812426d-c5be-463d-b47d-4531274fa390 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
71192025-04-30T06:29:57.308ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5812426d-c5be-463d-b47d-4531274fa390 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
71202025-04-30T06:29:57.314ZINFOtest_image_create (dropshot_internal): request completed latency_us = 7822 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5812426d-c5be-463d-b47d-4531274fa390 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
71212025-04-30T06:29:57.318ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "5812426d-c5be-463d-b47d-4531274fa390", "content-length": "405", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
71222025-04-30T06:29:57.319ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71232025-04-30T06:29:57.321ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b026077c-cf19-41c4-b4e0-a78513b010ae uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71242025-04-30T06:29:57.321ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b026077c-cf19-41c4-b4e0-a78513b010ae resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71252025-04-30T06:29:57.321ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b026077c-cf19-41c4-b4e0-a78513b010ae roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71262025-04-30T06:29:57.327ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b026077c-cf19-41c4-b4e0-a78513b010ae resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71272025-04-30T06:29:57.332ZINFOtest_image_create (dropshot_internal): request completed latency_us = 12550 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b026077c-cf19-41c4-b4e0-a78513b010ae response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71282025-04-30T06:29:57.334ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b026077c-cf19-41c4-b4e0-a78513b010ae", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:56 GMT"} })
71292025-04-30T06:29:57.334ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71302025-04-30T06:29:57.334ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
71312025-04-30T06:29:57.334ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
71322025-04-30T06:29:57.346ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71332025-04-30T06:29:57.347ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71342025-04-30T06:29:57.348ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
71352025-04-30T06:29:57.349ZINFOtest_image_create (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = 127.0.0.1:36387 remote_addr = 127.0.0.1:52624
71362025-04-30T06:29:57.350ZTRACtest_image_create (dropshot): incoming request local_addr = 127.0.0.1:36387 method = GET remote_addr = 127.0.0.1:52624 req_id = be7e8496-4fd9-4df8-b57a-73d68c8c9a59 uri = /95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71372025-04-30T06:29:57.354ZINFOtest_image_create (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4436 local_addr = 127.0.0.1:36387 method = GET remote_addr = 127.0.0.1:52624 req_id = be7e8496-4fd9-4df8-b57a-73d68c8c9a59 response_code = 200 uri = /95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71382025-04-30T06:29:57.358ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71392025-04-30T06:29:57.377ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71402025-04-30T06:29:57.377ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71412025-04-30T06:29:57.377ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
71422025-04-30T06:29:57.377ZDEBGtest_image_create (results-sink): inserting 17 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71432025-04-30T06:29:57.377ZDEBGtest_image_create (results-sink-cluster): inserting 17 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71442025-04-30T06:29:57.377ZDEBGtest_image_create (clickhouse-client): unrolling 17 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71452025-04-30T06:29:57.378ZDEBGtest_image_create (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71462025-04-30T06:29:57.378ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('integration_target:integration_metric') FORMAT Native;
71472025-04-30T06:29:57.378ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
71482025-04-30T06:29:57.378ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
71492025-04-30T06:29:57.379ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 581.207629ms iteration = 21 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
71502025-04-30T06:29:57.379ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 22 reason = Signaled
71512025-04-30T06:29:57.379ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
71522025-04-30T06:29:57.379ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
71532025-04-30T06:29:57.379ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
71542025-04-30T06:29:57.379ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71552025-04-30T06:29:57.381ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71562025-04-30T06:29:57.386ZTRACtest_image_create (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71572025-04-30T06:29:57.386ZDEBGtest_image_create (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-04-30T06:29:57.378337914Z } timeseries_name = http_service:request_latency_histogram
71582025-04-30T06:29:57.394ZDEBGtest_image_create (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71592025-04-30T06:29:57.397ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('http_service:request_latency_histogram', 'integration_target:integration_metric') FORMAT Native;
71602025-04-30T06:29:57.398ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71612025-04-30T06:29:57.414ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
71622025-04-30T06:29:57.414ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
71632025-04-30T06:29:57.414ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71642025-04-30T06:29:57.414ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71652025-04-30T06:29:57.415ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
71662025-04-30T06:29:57.415ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
71672025-04-30T06:29:57.415ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
71682025-04-30T06:29:57.415ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
71692025-04-30T06:29:57.416ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
71702025-04-30T06:29:57.416ZTRACtest_image_create (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71712025-04-30T06:29:57.416ZDEBGtest_image_create (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-04-30T06:29:57.394470447Z } timeseries_name = collection_target:cpus_provisioned
71722025-04-30T06:29:57.417ZDEBGtest_image_create (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71732025-04-30T06:29:57.417ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric') FORMAT Native;
71742025-04-30T06:29:57.424ZTRACtest_image_create (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71752025-04-30T06:29:57.424ZDEBGtest_image_create (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-04-30T06:29:57.417213411Z } timeseries_name = collection_target:ram_provisioned
71762025-04-30T06:29:57.424ZDEBGtest_image_create (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71772025-04-30T06:29:57.424ZTRACtest_image_create (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'collection_target:ram_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric') FORMAT Native;
71782025-04-30T06:29:57.426ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
71792025-04-30T06:29:57.427ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
71802025-04-30T06:29:57.427ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
71812025-04-30T06:29:57.427ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
71822025-04-30T06:29:57.429ZTRACtest_image_create (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71832025-04-30T06:29:57.429ZDEBGtest_image_create (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-04-30T06:29:57.424733494Z } timeseries_name = collection_target:virtual_disk_space_provisioned
71842025-04-30T06:29:57.434ZDEBGtest_image_create (clickhouse-client): inserting 4 new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
71852025-04-30T06:29:57.434ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 6 n_rows = 4 sql = INSERT INTO oximeter.timeseries_schema FORMAT Native
71862025-04-30T06:29:57.439ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71872025-04-30T06:29:57.451ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
71882025-04-30T06:29:57.451ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
71892025-04-30T06:29:57.451ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
71902025-04-30T06:29:57.451ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
71912025-04-30T06:29:57.456ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: f1 e0 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:49823 req_id = ca999c2e-d7bb-45cf-9bd7-3fad898ff8ac
71922025-04-30T06:29:57.457ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61920,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49823 req_id = ca999c2e-d7bb-45cf-9bd7-3fad898ff8ac
71932025-04-30T06:29:57.457ZDEBGtest_image_create (store): query key key = _mgs._tcp
71942025-04-30T06:29:57.457ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
71952025-04-30T06:29:57.457ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:49823 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = ca999c2e-d7bb-45cf-9bd7-3fad898ff8ac
71962025-04-30T06:29:57.459ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
71972025-04-30T06:29:57.460ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
71982025-04-30T06:29:57.460ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
71992025-04-30T06:29:57.460ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
72002025-04-30T06:29:57.462ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_string FORMAT Native
72012025-04-30T06:29:57.464ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3462, tv_nsec: 262921650 } })
72022025-04-30T06:29:57.464ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
72032025-04-30T06:29:57.464ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
72042025-04-30T06:29:57.464ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
72052025-04-30T06:29:57.465ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
72062025-04-30T06:29:57.467ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: dd 8b 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:55305 req_id = 98c13435-d061-40c2-9470-ed2539dd0ce1
72072025-04-30T06:29:57.467ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56715,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55305 req_id = 98c13435-d061-40c2-9470-ed2539dd0ce1
72082025-04-30T06:29:57.467ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
72092025-04-30T06:29:57.467ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:55305 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 98c13435-d061-40c2-9470-ed2539dd0ce1
72102025-04-30T06:29:57.469ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 10 table_name = fields_string
72112025-04-30T06:29:57.469ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 5 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
72122025-04-30T06:29:57.553ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
72132025-04-30T06:29:57.556ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
72142025-04-30T06:29:57.557ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72152025-04-30T06:29:57.569ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 5 table_name = fields_u16
72162025-04-30T06:29:57.570ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 17 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
72172025-04-30T06:29:57.572ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: eb 4d 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .M..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:51143 req_id = df880272-48f8-4d92-8f45-57acdbc85ab2
72182025-04-30T06:29:57.572ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60237,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51143 req_id = df880272-48f8-4d92-8f45-57acdbc85ab2
72192025-04-30T06:29:57.572ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
72202025-04-30T06:29:57.573ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60237, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:51143 req_id = df880272-48f8-4d92-8f45-57acdbc85ab2
72212025-04-30T06:29:57.579ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
72222025-04-30T06:29:57.579ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
72232025-04-30T06:29:57.579ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
72242025-04-30T06:29:57.580ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 17 table_name = fields_uuid
72252025-04-30T06:29:57.580ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 19 n_rows = 5 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
72262025-04-30T06:29:57.610ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 5 table_name = measurements_histogramu64
72272025-04-30T06:29:57.610ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
72282025-04-30T06:29:57.616ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 12 table_name = measurements_i64
72292025-04-30T06:29:57.616ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72302025-04-30T06:29:57.617ZTRACtest_image_create (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72312025-04-30T06:29:57.617ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec1adb60-40db-4885-9462-a754f97cbd34", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72322025-04-30T06:29:57.617ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
72332025-04-30T06:29:57.635ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d2a4b38-f802-42ff-b340-f645b0c0465a", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72342025-04-30T06:29:57.635ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
72352025-04-30T06:29:57.666ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
72362025-04-30T06:29:57.679ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
72372025-04-30T06:29:57.683ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c564def-fd0f-4d5f-a120-4f4255d0ca6c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72382025-04-30T06:29:57.691ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
72392025-04-30T06:29:57.699ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4aed6fa-bb54-4897-a2c4-974e35dc73f8", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72402025-04-30T06:29:57.699ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
72412025-04-30T06:29:57.702ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2a9c67a-1da3-4968-93ec-16a68be32c2a", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72422025-04-30T06:29:57.702ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
72432025-04-30T06:29:57.711ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "804a849e-ef56-458f-ac6d-ea51279da992", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72442025-04-30T06:29:57.711ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
72452025-04-30T06:29:57.715ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b29a25e9-dc22-4679-b126-f79f72e12726", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72462025-04-30T06:29:57.715ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
72472025-04-30T06:29:57.718ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "15e372ce-2845-40a8-bbbf-02c2025f8e6b", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72482025-04-30T06:29:57.718ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
72492025-04-30T06:29:57.719ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "10da407b-f79e-4727-8266-9a0d97151101", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72502025-04-30T06:29:57.720ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
72512025-04-30T06:29:57.722ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b87044a8-a4ae-4a92-9b8b-3a8c465d2053", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72522025-04-30T06:29:57.722ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
72532025-04-30T06:29:57.724ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1831b792-8b82-4f5e-8175-e7f0abfade86", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72542025-04-30T06:29:57.724ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
72552025-04-30T06:29:57.726ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca1486ca-a461-4daa-8a41-a7c8b1b4664c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72562025-04-30T06:29:57.726ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
72572025-04-30T06:29:57.729ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a981cc1d-d625-4950-94c2-b4c054c26a30", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72582025-04-30T06:29:57.730ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
72592025-04-30T06:29:57.730ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
72602025-04-30T06:29:57.730ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
72612025-04-30T06:29:57.730ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
72622025-04-30T06:29:57.730ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
72632025-04-30T06:29:57.731ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
72642025-04-30T06:29:57.734ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72652025-04-30T06:29:57.757ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
72662025-04-30T06:29:57.757ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
72672025-04-30T06:29:57.757ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
72682025-04-30T06:29:57.757ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
72692025-04-30T06:29:57.762ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
72702025-04-30T06:29:57.762ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
72712025-04-30T06:29:57.763ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
72722025-04-30T06:29:57.763ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7ff955-e6b7-4ae2-8c41-b6c4491cfc1d", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72732025-04-30T06:29:57.763ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
72742025-04-30T06:29:57.766ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "83b5e348-5032-4767-8edd-af821fa38d46", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72752025-04-30T06:29:57.766ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
72762025-04-30T06:29:57.768ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba2a800d-487c-414a-b0bc-2367cf21e19d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72772025-04-30T06:29:57.768ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
72782025-04-30T06:29:57.770ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "32218a08-7171-46c2-9fef-592e587eeeee", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72792025-04-30T06:29:57.770ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
72802025-04-30T06:29:57.772ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7730a160-2449-4148-8eff-92635f1a227f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72812025-04-30T06:29:57.772ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
72822025-04-30T06:29:57.782ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d89a0567-6c54-4997-b1fe-6b3da8c4a7d0", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72832025-04-30T06:29:57.782ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
72842025-04-30T06:29:57.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ec58197-60c6-409b-a7c0-b48d42878a99", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72852025-04-30T06:29:57.786ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
72862025-04-30T06:29:57.789ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc8f2407-5c9c-4a65-a372-31060f069034", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72872025-04-30T06:29:57.789ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
72882025-04-30T06:29:57.795ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0ce4358-4332-46ae-9a4e-17ba54af28cb", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72892025-04-30T06:29:57.795ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
72902025-04-30T06:29:57.803ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9542bda-4788-4cea-ba05-84173209ddec", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72912025-04-30T06:29:57.803ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
72922025-04-30T06:29:57.804ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
72932025-04-30T06:29:57.809ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d4cc481-3676-46e7-85a6-9c5a031afe21", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72942025-04-30T06:29:57.809ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
72952025-04-30T06:29:57.814ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c256ebc-5a7b-412c-b80d-5d345a4bc9b1", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72962025-04-30T06:29:57.815ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
72972025-04-30T06:29:57.817ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "367f37b1-9d7f-4a4f-af4a-f4792d1c049b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
72982025-04-30T06:29:57.818ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
72992025-04-30T06:29:57.821ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8b19455-801f-4fcb-8a94-bffc11ee76e5", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73002025-04-30T06:29:57.822ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
73012025-04-30T06:29:57.825ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "26fd0ce4-78ed-45a5-ad6a-1e95481eac19", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73022025-04-30T06:29:57.826ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
73032025-04-30T06:29:57.830ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b1602b5-f406-4171-9884-0d70c70aa889", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73042025-04-30T06:29:57.830ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
73052025-04-30T06:29:57.838ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b02894e3-e68c-4761-96dc-363674b359eb", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73062025-04-30T06:29:57.838ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
73072025-04-30T06:29:57.839ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c444b08-20f0-4c79-b90e-46e52793bd96", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73082025-04-30T06:29:57.840ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
73092025-04-30T06:29:57.841ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8569e8dd-6a80-4ac2-a1b1-a7286dea1797", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73102025-04-30T06:29:57.841ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
73112025-04-30T06:29:57.842ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "140bc2a8-30d5-4fd6-96b1-929e87e279ce", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73122025-04-30T06:29:57.842ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
73132025-04-30T06:29:57.844ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdf2c67e-dd71-46b3-888b-57269d8a3472", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73142025-04-30T06:29:57.844ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
73152025-04-30T06:29:57.847ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d2100bf-4d60-43bf-878f-eb77b6f5fe16", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73162025-04-30T06:29:57.847ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
73172025-04-30T06:29:57.849ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "08288ed8-22d3-4351-8bba-d5f9c10f84dd", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73182025-04-30T06:29:57.849ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
73192025-04-30T06:29:57.852ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a3ec999-bbd9-4f9c-81ce-e636d0cc78d4", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73202025-04-30T06:29:57.852ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
73212025-04-30T06:29:57.855ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
73222025-04-30T06:29:57.855ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
73232025-04-30T06:29:57.856ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
73242025-04-30T06:29:57.856ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
73252025-04-30T06:29:57.857ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
73262025-04-30T06:29:57.857ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bde54e8f-dd9f-4e2d-ad9a-d729a8f0b57d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73272025-04-30T06:29:57.858ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
73282025-04-30T06:29:57.863ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292025-04-30T06:29:57.871ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
73302025-04-30T06:29:57.871ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
73312025-04-30T06:29:57.871ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
73322025-04-30T06:29:57.872ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
73332025-04-30T06:29:57.872ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "80f8381d-bcb3-475a-87e9-b928d4ed2b64", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73342025-04-30T06:29:57.872ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
73352025-04-30T06:29:57.874ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
73362025-04-30T06:29:57.874ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
73372025-04-30T06:29:57.875ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
73382025-04-30T06:29:57.876ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fadeb46-314c-4473-8bcc-34616be4f553", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73392025-04-30T06:29:57.877ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
73402025-04-30T06:29:57.883ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0eaacd4d-d4c2-489e-9837-ba3a208ad82f", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73412025-04-30T06:29:57.884ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
73422025-04-30T06:29:57.887ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "801f56e6-477d-425f-bff8-7a7356499c4c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73432025-04-30T06:29:57.887ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
73442025-04-30T06:29:57.888ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "41fd4c4d-0c69-4919-841d-1418dc56dba9", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73452025-04-30T06:29:57.889ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
73462025-04-30T06:29:57.895ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "976c7895-e79a-46ce-95d1-0dcd9235f7be", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73472025-04-30T06:29:57.895ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
73482025-04-30T06:29:57.897ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f17ef0e-dd34-4c41-8519-8bb7a5140d65", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73492025-04-30T06:29:57.897ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
73502025-04-30T06:29:57.897ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
73512025-04-30T06:29:57.897ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
73522025-04-30T06:29:57.897ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73532025-04-30T06:29:57.899ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73542025-04-30T06:29:57.902ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73552025-04-30T06:29:57.907ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
73562025-04-30T06:29:57.907ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
73572025-04-30T06:29:57.907ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
73582025-04-30T06:29:57.907ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
73592025-04-30T06:29:57.908ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73602025-04-30T06:29:57.908ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73612025-04-30T06:29:57.918ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73622025-04-30T06:29:57.923ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
73632025-04-30T06:29:57.924ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
73642025-04-30T06:29:57.924ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73652025-04-30T06:29:57.926ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73662025-04-30T06:29:58.024ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
73672025-04-30T06:29:58.024ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
73682025-04-30T06:29:58.025ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
73692025-04-30T06:29:58.027ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:46604 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
73702025-04-30T06:29:58.035ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:46604 req_id = 9e89cd75-9618-4f3f-83f7-68526769c87f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
73712025-04-30T06:29:58.036ZINFOtest_image_create (dropshot): request completed latency_us = 1560 local_addr = [::1]:42828 method = GET remote_addr = [::1]:46604 req_id = 9e89cd75-9618-4f3f-83f7-68526769c87f response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
73722025-04-30T06:29:58.036ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e89cd75-9618-4f3f-83f7-68526769c87f", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
73732025-04-30T06:29:58.041ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
73742025-04-30T06:29:58.041ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
73752025-04-30T06:29:58.041ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
73762025-04-30T06:29:58.043ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
73772025-04-30T06:29:58.043ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
73782025-04-30T06:29:58.043ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
73792025-04-30T06:29:58.043ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73802025-04-30T06:29:58.044ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73812025-04-30T06:29:58.047ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73822025-04-30T06:29:58.053ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
73832025-04-30T06:29:58.053ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
73842025-04-30T06:29:58.053ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73852025-04-30T06:29:58.054ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73862025-04-30T06:29:58.078ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
73872025-04-30T06:29:58.078ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
73882025-04-30T06:29:58.078ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
73892025-04-30T06:29:58.078ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
73902025-04-30T06:29:58.079ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
73912025-04-30T06:29:58.089ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73922025-04-30T06:29:58.098ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
73932025-04-30T06:29:58.098ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
73942025-04-30T06:29:58.098ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
73952025-04-30T06:29:58.098ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
73962025-04-30T06:29:58.156ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
73972025-04-30T06:29:58.156ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
73982025-04-30T06:29:58.157ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
73992025-04-30T06:29:58.158ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
74002025-04-30T06:29:58.158ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
74012025-04-30T06:29:58.158ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 779.429151ms iteration = 22 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
74022025-04-30T06:29:58.158ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 23 reason = Signaled
74032025-04-30T06:29:58.158ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
74042025-04-30T06:29:58.158ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
74052025-04-30T06:29:58.158ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
74062025-04-30T06:29:58.158ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74072025-04-30T06:29:58.159ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
74082025-04-30T06:29:58.161ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74092025-04-30T06:29:58.166ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
74102025-04-30T06:29:58.166ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
74112025-04-30T06:29:58.166ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74122025-04-30T06:29:58.166ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
74132025-04-30T06:29:58.170ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
74142025-04-30T06:29:58.170ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
74152025-04-30T06:29:58.171ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: f5 37 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .7..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:62716 req_id = 63f00dc6-4714-44d3-ae0a-e99c5670e550
74162025-04-30T06:29:58.171ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62775,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62716 req_id = 63f00dc6-4714-44d3-ae0a-e99c5670e550
74172025-04-30T06:29:58.172ZDEBGtest_image_create (store): query key key = _mgs._tcp
74182025-04-30T06:29:58.172ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
74192025-04-30T06:29:58.172ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:62716 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 63f00dc6-4714-44d3-ae0a-e99c5670e550
74202025-04-30T06:29:58.173ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3462, tv_nsec: 972290410 } })
74212025-04-30T06:29:58.173ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
74222025-04-30T06:29:58.173ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 43 af 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e C...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:62914 req_id = 7764f7ae-b285-4ad6-bfa8-8a9417ef1d0b
74232025-04-30T06:29:58.173ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 17327,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62914 req_id = 7764f7ae-b285-4ad6-bfa8-8a9417ef1d0b
74242025-04-30T06:29:58.173ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
74252025-04-30T06:29:58.174ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62914 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 7764f7ae-b285-4ad6-bfa8-8a9417ef1d0b
74262025-04-30T06:29:58.223ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
74272025-04-30T06:29:58.224ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 5b 76 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c [v..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:52172 req_id = 49f91f5f-8f04-45df-ae7e-76cddf2a3ad7
74282025-04-30T06:29:58.224ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 23414,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52172 req_id = 49f91f5f-8f04-45df-ae7e-76cddf2a3ad7
74292025-04-30T06:29:58.224ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
74302025-04-30T06:29:58.224ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23414, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:52172 req_id = 49f91f5f-8f04-45df-ae7e-76cddf2a3ad7
74312025-04-30T06:29:58.224ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
74322025-04-30T06:29:58.224ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
74332025-04-30T06:29:58.224ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
74342025-04-30T06:29:58.229ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ae0637e-9716-4f37-ab32-1056cb4cb653", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74352025-04-30T06:29:58.230ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
74362025-04-30T06:29:58.233ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1a337e9-f5d6-4087-b440-85029a94f4b9", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74372025-04-30T06:29:58.235ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
74382025-04-30T06:29:58.238ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "08cda6f9-d1d7-479b-bd24-789e59b61fc4", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74392025-04-30T06:29:58.239ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
74402025-04-30T06:29:58.245ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4aa1edc-0c51-4063-8126-2f009e75ad5f", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74412025-04-30T06:29:58.246ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
74422025-04-30T06:29:58.248ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
74432025-04-30T06:29:58.253ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ba66c40-dd29-4189-a46e-97a9d886d8f2", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74442025-04-30T06:29:58.254ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
74452025-04-30T06:29:58.258ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b6dbf85-d0b6-49a2-bcc2-c59b840ebde0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74462025-04-30T06:29:58.258ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
74472025-04-30T06:29:58.261ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4ab0f03-bceb-4b27-8c6e-fdf85b03feb9", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74482025-04-30T06:29:58.262ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
74492025-04-30T06:29:58.265ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aff3af16-1fa4-458e-81a2-ec01d69e14f6", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74502025-04-30T06:29:58.265ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
74512025-04-30T06:29:58.266ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f07a50-5f04-43e6-8847-f2d2fee3d0fd", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74522025-04-30T06:29:58.267ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
74532025-04-30T06:29:58.268ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5aa10937-bf25-4907-a93f-0b8963e52aae", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74542025-04-30T06:29:58.268ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
74552025-04-30T06:29:58.269ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5eb060-f516-48f8-8603-c40bc5e87a7f", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74562025-04-30T06:29:58.270ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
74572025-04-30T06:29:58.279ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dfa2053-c428-47d7-994e-aba545925f55", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74582025-04-30T06:29:58.279ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
74592025-04-30T06:29:58.284ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "84083c3c-2203-41c0-826d-d6a116184029", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74602025-04-30T06:29:58.284ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
74612025-04-30T06:29:58.287ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "001ce7dc-031e-487c-a373-5f141a93ae08", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74622025-04-30T06:29:58.288ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
74632025-04-30T06:29:58.292ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "87590ca7-b829-4b8f-a671-c037d3966649", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74642025-04-30T06:29:58.292ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
74652025-04-30T06:29:58.295ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e91b1fd3-f5ad-4301-ac25-3958ebc0889e", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74662025-04-30T06:29:58.296ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
74672025-04-30T06:29:58.298ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b45d2dc8-5461-405e-94d8-2c2da1f84a1b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74682025-04-30T06:29:58.299ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
74692025-04-30T06:29:58.299ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
74702025-04-30T06:29:58.299ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
74712025-04-30T06:29:58.299ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
74722025-04-30T06:29:58.299ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
74732025-04-30T06:29:58.300ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
74742025-04-30T06:29:58.304ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "339644aa-ef07-47c8-87f4-259f63d28fc8", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74752025-04-30T06:29:58.304ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
74762025-04-30T06:29:58.304ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772025-04-30T06:29:58.314ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
74782025-04-30T06:29:58.314ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
74792025-04-30T06:29:58.314ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
74802025-04-30T06:29:58.315ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
74812025-04-30T06:29:58.318ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
74822025-04-30T06:29:58.318ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
74832025-04-30T06:29:58.319ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
74842025-04-30T06:29:58.321ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c211133a-95fb-490e-b3b6-1edeeaf1e8b0", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74852025-04-30T06:29:58.321ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
74862025-04-30T06:29:58.324ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "270675e3-1433-47d5-9b75-db14d6caee40", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74872025-04-30T06:29:58.325ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
74882025-04-30T06:29:58.329ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9893c99c-5592-4622-a8a4-80a2fc5b4a0b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74892025-04-30T06:29:58.330ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
74902025-04-30T06:29:58.333ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6332c56e-628d-48a3-9fd3-0c6e3b2ed897", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74912025-04-30T06:29:58.333ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
74922025-04-30T06:29:58.335ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b45b95ad-77fd-43cc-ae28-f07861400cec", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74932025-04-30T06:29:58.336ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
74942025-04-30T06:29:58.338ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "514e4391-d391-4c9d-8066-704ed05c20ea", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74952025-04-30T06:29:58.338ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
74962025-04-30T06:29:58.341ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd390607-ff8d-4e72-85c5-26e94c0fada3", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74972025-04-30T06:29:58.341ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
74982025-04-30T06:29:58.347ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f13690f2-7d38-419d-a18c-50d6660f5866", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:57 GMT"} })
74992025-04-30T06:29:58.347ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
75002025-04-30T06:29:58.353ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "60c9265f-4750-4662-83fa-b69c8c042297", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75012025-04-30T06:29:58.353ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
75022025-04-30T06:29:58.357ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
75032025-04-30T06:29:58.362ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97123a78-26f6-444c-87a1-35467212b738", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75042025-04-30T06:29:58.362ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
75052025-04-30T06:29:58.365ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5d07607-f784-4443-a3c6-639a87c680f4", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75062025-04-30T06:29:58.365ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
75072025-04-30T06:29:58.368ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d225b8f1-5580-4a0e-bbaa-f04e0edad4e5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75082025-04-30T06:29:58.368ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
75092025-04-30T06:29:58.369ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "68164824-17a6-4852-8b6c-fca6185d6747", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75102025-04-30T06:29:58.369ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
75112025-04-30T06:29:58.370ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "17bb9d22-6044-4ea2-9b73-374a6e84bc22", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75122025-04-30T06:29:58.370ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
75132025-04-30T06:29:58.371ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "190dc881-53f7-4cd7-87b9-b68dc3b6c461", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75142025-04-30T06:29:58.372ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
75152025-04-30T06:29:58.373ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "44418057-f406-4241-9453-3d6a3c1327f4", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75162025-04-30T06:29:58.373ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
75172025-04-30T06:29:58.374ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ffd631-f052-4e6a-90c4-fdd047f57ebc", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75182025-04-30T06:29:58.375ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
75192025-04-30T06:29:58.377ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b8126d3-96c8-491e-8829-729d457318fe", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75202025-04-30T06:29:58.377ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
75212025-04-30T06:29:58.380ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6eb6fb2-3c1b-44d6-b401-824150778257", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75222025-04-30T06:29:58.380ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
75232025-04-30T06:29:58.382ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dda50b76-d807-4ac2-a3a9-164b15d00c88", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75242025-04-30T06:29:58.382ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
75252025-04-30T06:29:58.384ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0266510-201d-4fce-97e1-c5415cdea67d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75262025-04-30T06:29:58.384ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
75272025-04-30T06:29:58.387ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "48756c8f-9959-4d0f-bce1-299f89d9b690", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75282025-04-30T06:29:58.387ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
75292025-04-30T06:29:58.391ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "599dc585-ba57-42df-95bd-bab5bbfe1361", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75302025-04-30T06:29:58.391ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
75312025-04-30T06:29:58.392ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "af44cfd0-c010-4397-a00a-2f7395000062", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75322025-04-30T06:29:58.393ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
75332025-04-30T06:29:58.394ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "53c84b3d-a96e-4d53-af6b-92957a2a98b9", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75342025-04-30T06:29:58.394ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
75352025-04-30T06:29:58.396ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fc900dc-427e-4277-a366-c734889e97cf", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75362025-04-30T06:29:58.396ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
75372025-04-30T06:29:58.398ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9b1b599-fafa-4a00-9a19-b8fb229dc5fa", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75382025-04-30T06:29:58.399ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
75392025-04-30T06:29:58.399ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75402025-04-30T06:29:58.399ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
75412025-04-30T06:29:58.399ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75422025-04-30T06:29:58.401ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75432025-04-30T06:29:58.404ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75442025-04-30T06:29:58.413ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
75452025-04-30T06:29:58.413ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
75462025-04-30T06:29:58.413ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75472025-04-30T06:29:58.413ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
75482025-04-30T06:29:58.413ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75492025-04-30T06:29:58.414ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75502025-04-30T06:29:58.415ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
75512025-04-30T06:29:58.415ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75522025-04-30T06:29:58.415ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
75532025-04-30T06:29:58.415ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
75542025-04-30T06:29:58.415ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
75552025-04-30T06:29:58.417ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75562025-04-30T06:29:58.422ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
75572025-04-30T06:29:58.422ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
75582025-04-30T06:29:58.422ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75592025-04-30T06:29:58.424ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75602025-04-30T06:29:58.426ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
75612025-04-30T06:29:58.426ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
75622025-04-30T06:29:58.428ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75632025-04-30T06:29:58.436ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
75642025-04-30T06:29:58.436ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
75652025-04-30T06:29:58.437ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
75662025-04-30T06:29:58.438ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
75672025-04-30T06:29:58.518ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
75682025-04-30T06:29:58.518ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
75692025-04-30T06:29:58.519ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:41984 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
75702025-04-30T06:29:58.519ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75712025-04-30T06:29:58.520ZTRACtest_image_create (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75722025-04-30T06:29:58.520ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
75732025-04-30T06:29:58.521ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
75742025-04-30T06:29:58.521ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
75752025-04-30T06:29:58.521ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
75762025-04-30T06:29:58.522ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
75772025-04-30T06:29:58.523ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
75782025-04-30T06:29:58.525ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
75792025-04-30T06:29:58.525ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
75802025-04-30T06:29:58.526ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
75812025-04-30T06:29:58.529ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:41984 req_id = 2133e6cd-20d6-47b8-a547-ec8527d7dd21 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
75822025-04-30T06:29:58.530ZINFOtest_image_create (dropshot): request completed latency_us = 959 local_addr = [::1]:42828 method = GET remote_addr = [::1]:41984 req_id = 2133e6cd-20d6-47b8-a547-ec8527d7dd21 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
75832025-04-30T06:29:58.538ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2133e6cd-20d6-47b8-a547-ec8527d7dd21", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
75842025-04-30T06:29:58.543ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
75852025-04-30T06:29:58.543ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
75862025-04-30T06:29:58.543ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
75872025-04-30T06:29:58.546ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
75882025-04-30T06:29:58.546ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75892025-04-30T06:29:58.546ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
75902025-04-30T06:29:58.546ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75912025-04-30T06:29:58.547ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75922025-04-30T06:29:58.549ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
75932025-04-30T06:29:58.550ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
75942025-04-30T06:29:58.557ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75952025-04-30T06:29:58.568ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
75962025-04-30T06:29:58.568ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
75972025-04-30T06:29:58.568ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75982025-04-30T06:29:58.569ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75992025-04-30T06:29:58.571ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
76002025-04-30T06:29:58.571ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
76012025-04-30T06:29:58.638ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
76022025-04-30T06:29:58.638ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
76032025-04-30T06:29:58.639ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
76042025-04-30T06:29:58.639ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 480.938609ms iteration = 23 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
76052025-04-30T06:29:58.639ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 24 reason = Signaled
76062025-04-30T06:29:58.639ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
76072025-04-30T06:29:58.639ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76082025-04-30T06:29:58.639ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
76092025-04-30T06:29:58.639ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76102025-04-30T06:29:58.640ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76112025-04-30T06:29:58.644ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76122025-04-30T06:29:58.649ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
76132025-04-30T06:29:58.649ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
76142025-04-30T06:29:58.649ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76152025-04-30T06:29:58.650ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76162025-04-30T06:29:58.659ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
76172025-04-30T06:29:58.659ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
76182025-04-30T06:29:58.660ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 72 16 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 r............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:54385 req_id = 6d5141c2-0c52-4b95-94f1-be986c64c110
76192025-04-30T06:29:58.660ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 29206,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54385 req_id = 6d5141c2-0c52-4b95-94f1-be986c64c110
76202025-04-30T06:29:58.660ZDEBGtest_image_create (store): query key key = _mgs._tcp
76212025-04-30T06:29:58.661ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
76222025-04-30T06:29:58.661ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:54385 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 6d5141c2-0c52-4b95-94f1-be986c64c110
76232025-04-30T06:29:58.661ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3463, tv_nsec: 460881526 } })
76242025-04-30T06:29:58.662ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
76252025-04-30T06:29:58.662ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 54 c3 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e T...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:59367 req_id = c70be5f2-677a-4246-9f09-59fd97875f90
76262025-04-30T06:29:58.662ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 21699,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59367 req_id = c70be5f2-677a-4246-9f09-59fd97875f90
76272025-04-30T06:29:58.662ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
76282025-04-30T06:29:58.663ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59367 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = c70be5f2-677a-4246-9f09-59fd97875f90
76292025-04-30T06:29:58.740ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
76302025-04-30T06:29:58.741ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
76312025-04-30T06:29:58.741ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76322025-04-30T06:29:58.741ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
76332025-04-30T06:29:58.741ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
76342025-04-30T06:29:58.743ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
76352025-04-30T06:29:58.743ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 2f 30 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c /0..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:62065 req_id = f5cd182d-ca3e-4845-919e-46b2c7712f5e
76362025-04-30T06:29:58.743ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 12080,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62065 req_id = f5cd182d-ca3e-4845-919e-46b2c7712f5e
76372025-04-30T06:29:58.744ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
76382025-04-30T06:29:58.744ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12080, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:62065 req_id = f5cd182d-ca3e-4845-919e-46b2c7712f5e
76392025-04-30T06:29:58.744ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
76402025-04-30T06:29:58.744ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
76412025-04-30T06:29:58.744ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
76422025-04-30T06:29:58.747ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76432025-04-30T06:29:58.757ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
76442025-04-30T06:29:58.757ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
76452025-04-30T06:29:58.757ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
76462025-04-30T06:29:58.758ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
76472025-04-30T06:29:58.764ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
76482025-04-30T06:29:58.764ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
76492025-04-30T06:29:58.766ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
76502025-04-30T06:29:58.766ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "24fd0416-1105-49e0-933b-7fdbfb3d1300", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76512025-04-30T06:29:58.766ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
76522025-04-30T06:29:58.770ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cb3a5af-18fd-4390-b865-d5d7c3b1ec26", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76532025-04-30T06:29:58.770ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
76542025-04-30T06:29:58.774ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "962dc3ea-ecd9-478e-bd0e-4e0c22ed0dc6", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76552025-04-30T06:29:58.775ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
76562025-04-30T06:29:58.778ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5aa93ede-642f-45d5-91c8-aae5b9d75794", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76572025-04-30T06:29:58.779ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
76582025-04-30T06:29:58.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "159de3fd-6b98-4f05-ba0a-aea51bfdcafd", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76592025-04-30T06:29:58.786ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
76602025-04-30T06:29:58.791ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0014635-66ed-46a3-ac8f-b535c0784543", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76612025-04-30T06:29:58.791ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
76622025-04-30T06:29:58.798ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ea0f2fe-4656-4543-9a2a-c6c60ed7fb9d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76632025-04-30T06:29:58.798ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
76642025-04-30T06:29:58.799ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
76652025-04-30T06:29:58.802ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e5409af-5614-4ebf-b50e-2827b59febd8", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76662025-04-30T06:29:58.804ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
76672025-04-30T06:29:58.805ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5f5d7ca-62fa-476d-a5b4-7a5398769539", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76682025-04-30T06:29:58.805ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
76692025-04-30T06:29:58.807ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab00456b-9f39-4d2f-9766-b927b53ba7fa", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76702025-04-30T06:29:58.807ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
76712025-04-30T06:29:58.811ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "84513689-9ca1-49a6-903f-93f3676f0b7c", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76722025-04-30T06:29:58.811ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
76732025-04-30T06:29:58.813ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ed55ce2-79bf-4669-9f1a-a9df95fce826", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76742025-04-30T06:29:58.813ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
76752025-04-30T06:29:58.815ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "63c7c0b8-3db7-4665-aef4-9ccf50ebbb87", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76762025-04-30T06:29:58.815ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
76772025-04-30T06:29:58.820ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a31c914-56ea-4e62-bfcc-4ec726f9ae56", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76782025-04-30T06:29:58.821ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
76792025-04-30T06:29:58.824ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f276111b-67a4-4485-aa86-a7ac989dd159", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76802025-04-30T06:29:58.825ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
76812025-04-30T06:29:58.827ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a2efa8d-2cad-47eb-9696-49afc188c90d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76822025-04-30T06:29:58.828ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
76832025-04-30T06:29:58.831ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbfb4e64-f1cf-40c3-8edf-f97d2078dcb4", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76842025-04-30T06:29:58.831ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
76852025-04-30T06:29:58.836ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b428a619-8863-4d98-a5fe-882b0392a5a6", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76862025-04-30T06:29:58.836ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
76872025-04-30T06:29:58.841ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f746f66f-07f6-460b-8d65-f5f49948244e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76882025-04-30T06:29:58.841ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
76892025-04-30T06:29:58.843ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "524d6aaf-132d-4fe0-81c1-b1a2634d4b0f", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76902025-04-30T06:29:58.843ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
76912025-04-30T06:29:58.844ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "65a4055e-e76b-4f37-97db-0da3ff69361a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76922025-04-30T06:29:58.845ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
76932025-04-30T06:29:58.846ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "02ad966b-ea89-4da5-93ad-bc99bc19b052", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76942025-04-30T06:29:58.846ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
76952025-04-30T06:29:58.847ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7712f805-1b19-4dcc-9560-c7795a494526", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76962025-04-30T06:29:58.847ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
76972025-04-30T06:29:58.851ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "58679e08-af94-4696-83fe-55588de43744", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
76982025-04-30T06:29:58.851ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
76992025-04-30T06:29:58.851ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
77002025-04-30T06:29:58.852ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
77012025-04-30T06:29:58.852ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
77022025-04-30T06:29:58.852ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
77032025-04-30T06:29:58.853ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
77042025-04-30T06:29:58.855ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f0611a6-fe8a-4083-b7c6-d69955d7100b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77052025-04-30T06:29:58.855ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
77062025-04-30T06:29:58.856ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072025-04-30T06:29:58.884ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
77082025-04-30T06:29:58.884ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
77092025-04-30T06:29:58.884ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
77102025-04-30T06:29:58.885ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
77112025-04-30T06:29:58.888ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
77122025-04-30T06:29:58.888ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
77132025-04-30T06:29:58.888ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
77142025-04-30T06:29:58.890ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c4110c5-f52f-49f0-81dd-2fe691c6dc7d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77152025-04-30T06:29:58.890ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
77162025-04-30T06:29:58.903ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c4840a4-33f1-4967-979a-5a4897e2982b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77172025-04-30T06:29:58.904ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
77182025-04-30T06:29:58.908ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e7c7162-08a4-4540-9079-fc738e20bff5", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77192025-04-30T06:29:58.909ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
77202025-04-30T06:29:58.912ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a0ebb60-327e-4f5b-a049-696d7e2ee78e", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77212025-04-30T06:29:58.913ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
77222025-04-30T06:29:58.920ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d7e3418-8ba2-40d5-b845-22ce36f4a8fe", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77232025-04-30T06:29:58.920ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
77242025-04-30T06:29:58.923ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "23badd89-b63a-4c08-93b8-516154cb0071", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77252025-04-30T06:29:58.923ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
77262025-04-30T06:29:58.924ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "355aae51-61bd-4fb7-b4b6-bad5f44fd7f2", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77272025-04-30T06:29:58.924ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
77282025-04-30T06:29:58.927ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "16203d23-b11d-4b42-a80d-9cdf1af5791b", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77292025-04-30T06:29:58.927ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
77302025-04-30T06:29:58.927ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
77312025-04-30T06:29:58.929ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "39b26bee-f0c4-410b-98f1-e4b79d0e163f", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77322025-04-30T06:29:58.929ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
77332025-04-30T06:29:58.931ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fca25991-4c01-41c1-b8f3-c06d86e03881", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77342025-04-30T06:29:58.932ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
77352025-04-30T06:29:58.938ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "88d54e10-2081-40b8-8578-a694c0e98dde", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77362025-04-30T06:29:58.939ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
77372025-04-30T06:29:58.941ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e773c239-62ab-4070-94fe-54288a707fb0", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77382025-04-30T06:29:58.941ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
77392025-04-30T06:29:58.944ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9748398-f04a-4758-9a5a-e54756d4839e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77402025-04-30T06:29:58.944ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
77412025-04-30T06:29:58.947ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a764cdd-c941-44c0-9159-6fcb1acf1926", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77422025-04-30T06:29:58.948ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
77432025-04-30T06:29:58.949ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "792c8428-0451-4792-ae68-8f3bc0d119b6", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77442025-04-30T06:29:58.950ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
77452025-04-30T06:29:58.952ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6b9854f-4f11-4b41-992a-275d04b5d807", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77462025-04-30T06:29:58.952ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
77472025-04-30T06:29:58.953ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7245d353-7203-4fc1-87c9-4e15d0fd00f1", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77482025-04-30T06:29:58.953ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
77492025-04-30T06:29:58.955ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "86bcb4b3-f897-49a8-9783-9e177461d6e0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77502025-04-30T06:29:58.955ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
77512025-04-30T06:29:58.956ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "36cb4365-1afd-4a35-b3eb-6e2670dc7f02", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77522025-04-30T06:29:58.956ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
77532025-04-30T06:29:58.957ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "69e58f83-7e10-49df-8463-d5dc05d2f3a4", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77542025-04-30T06:29:58.957ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
77552025-04-30T06:29:58.957ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
77562025-04-30T06:29:58.957ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
77572025-04-30T06:29:58.957ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77582025-04-30T06:29:58.958ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77592025-04-30T06:29:58.964ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77602025-04-30T06:29:58.969ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
77612025-04-30T06:29:58.973ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
77622025-04-30T06:29:58.973ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
77632025-04-30T06:29:58.973ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
77642025-04-30T06:29:58.973ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77652025-04-30T06:29:58.975ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77662025-04-30T06:29:58.979ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
77672025-04-30T06:29:58.980ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
77682025-04-30T06:29:58.980ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
77692025-04-30T06:29:58.980ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
77702025-04-30T06:29:58.980ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
77712025-04-30T06:29:58.982ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77722025-04-30T06:29:58.988ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
77732025-04-30T06:29:58.988ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
77742025-04-30T06:29:58.988ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77752025-04-30T06:29:58.990ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77762025-04-30T06:29:58.994ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77772025-04-30T06:29:59.009ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
77782025-04-30T06:29:59.009ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
77792025-04-30T06:29:59.009ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
77802025-04-30T06:29:59.009ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
77812025-04-30T06:29:59.071ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
77822025-04-30T06:29:59.071ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
77832025-04-30T06:29:59.072ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:65417 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
77842025-04-30T06:29:59.073ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:65417 req_id = ffe05940-49ba-4b00-b67e-2d0f042e02b6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
77852025-04-30T06:29:59.074ZINFOtest_image_create (dropshot): request completed latency_us = 1053 local_addr = [::1]:42828 method = GET remote_addr = [::1]:65417 req_id = ffe05940-49ba-4b00-b67e-2d0f042e02b6 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
77862025-04-30T06:29:59.075ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
77872025-04-30T06:29:59.075ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
77882025-04-30T06:29:59.077ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
77892025-04-30T06:29:59.077ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffe05940-49ba-4b00-b67e-2d0f042e02b6", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
77902025-04-30T06:29:59.085ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
77912025-04-30T06:29:59.085ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
77922025-04-30T06:29:59.085ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
77932025-04-30T06:29:59.091ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
77942025-04-30T06:29:59.091ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
77952025-04-30T06:29:59.091ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
77962025-04-30T06:29:59.091ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77972025-04-30T06:29:59.093ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77982025-04-30T06:29:59.098ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77992025-04-30T06:29:59.103ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
78002025-04-30T06:29:59.103ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
78012025-04-30T06:29:59.103ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78022025-04-30T06:29:59.103ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78032025-04-30T06:29:59.143ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
78042025-04-30T06:29:59.149ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
78052025-04-30T06:29:59.149ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
78062025-04-30T06:29:59.150ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 510.432954ms iteration = 24 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
78072025-04-30T06:29:59.150ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 25 reason = Signaled
78082025-04-30T06:29:59.150ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
78092025-04-30T06:29:59.150ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
78102025-04-30T06:29:59.150ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
78112025-04-30T06:29:59.150ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78122025-04-30T06:29:59.151ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78132025-04-30T06:29:59.154ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78142025-04-30T06:29:59.160ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
78152025-04-30T06:29:59.160ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
78162025-04-30T06:29:59.160ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78172025-04-30T06:29:59.161ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78182025-04-30T06:29:59.164ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
78192025-04-30T06:29:59.164ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
78202025-04-30T06:29:59.165ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 05 80 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:56742 req_id = 2a5744ce-9f13-43d4-80db-705f2f5ef942
78212025-04-30T06:29:59.165ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1408,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56742 req_id = 2a5744ce-9f13-43d4-80db-705f2f5ef942
78222025-04-30T06:29:59.165ZDEBGtest_image_create (store): query key key = _mgs._tcp
78232025-04-30T06:29:59.165ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
78242025-04-30T06:29:59.165ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:56742 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 2a5744ce-9f13-43d4-80db-705f2f5ef942
78252025-04-30T06:29:59.166ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3463, tv_nsec: 965186931 } })
78262025-04-30T06:29:59.166ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
78272025-04-30T06:29:59.166ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 3e 20 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e > ..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56871 req_id = ecaeb695-5eb8-44e8-865d-8a4801767ee5
78282025-04-30T06:29:59.166ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 15904,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56871 req_id = ecaeb695-5eb8-44e8-865d-8a4801767ee5
78292025-04-30T06:29:59.166ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
78302025-04-30T06:29:59.166ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56871 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = ecaeb695-5eb8-44e8-865d-8a4801767ee5
78312025-04-30T06:29:59.220ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
78322025-04-30T06:29:59.221ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
78332025-04-30T06:29:59.221ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
78342025-04-30T06:29:59.221ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
78352025-04-30T06:29:59.221ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
78362025-04-30T06:29:59.222ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
78372025-04-30T06:29:59.223ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: cb fb 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:52723 req_id = fec5d006-5ace-4f64-b99f-b0e283149af0
78382025-04-30T06:29:59.223ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52219,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52723 req_id = fec5d006-5ace-4f64-b99f-b0e283149af0
78392025-04-30T06:29:59.223ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
78402025-04-30T06:29:59.223ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52219, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:52723 req_id = fec5d006-5ace-4f64-b99f-b0e283149af0
78412025-04-30T06:29:59.224ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
78422025-04-30T06:29:59.224ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
78432025-04-30T06:29:59.224ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
78442025-04-30T06:29:59.225ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78452025-04-30T06:29:59.232ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
78462025-04-30T06:29:59.232ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
78472025-04-30T06:29:59.232ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
78482025-04-30T06:29:59.232ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
78492025-04-30T06:29:59.237ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd127f21-c779-45cd-b9de-3f69eba83010", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78502025-04-30T06:29:59.238ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
78512025-04-30T06:29:59.238ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
78522025-04-30T06:29:59.238ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
78532025-04-30T06:29:59.239ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
78542025-04-30T06:29:59.243ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a5cbd67-0c45-4f9c-a2cc-41f46882e7e9", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78552025-04-30T06:29:59.243ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
78562025-04-30T06:29:59.250ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a64d05b-b0c9-45ca-9632-c242695928e5", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78572025-04-30T06:29:59.250ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
78582025-04-30T06:29:59.261ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "18d6d86d-8f5e-4275-9463-e6faf8243228", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78592025-04-30T06:29:59.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
78602025-04-30T06:29:59.266ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4134ff93-1859-4e30-869e-18a52b9293ec", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78612025-04-30T06:29:59.266ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
78622025-04-30T06:29:59.269ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b297b1c0-30fd-4adc-8704-85de92ef3848", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78632025-04-30T06:29:59.269ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
78642025-04-30T06:29:59.272ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d063d45-bf54-4bc1-b161-c2d825845679", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78652025-04-30T06:29:59.272ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
78662025-04-30T06:29:59.282ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "53e04722-e4d4-486c-b52b-6f6ea0a0683f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78672025-04-30T06:29:59.283ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
78682025-04-30T06:29:59.284ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
78692025-04-30T06:29:59.290ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3da2dfd0-aa9a-469b-bb19-b930da6c5c93", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78702025-04-30T06:29:59.290ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
78712025-04-30T06:29:59.292ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "65523b06-5419-40b6-8f3b-e60b31b168d3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78722025-04-30T06:29:59.292ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
78732025-04-30T06:29:59.294ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9edf37a4-fa72-493f-98e2-a24281665cb8", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78742025-04-30T06:29:59.294ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
78752025-04-30T06:29:59.296ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1e57f47-868d-4732-91d2-ae9aeaa225ae", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78762025-04-30T06:29:59.296ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
78772025-04-30T06:29:59.298ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c387b4cc-963f-44b2-88f1-31d65cfe6118", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78782025-04-30T06:29:59.300ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
78792025-04-30T06:29:59.306ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
78802025-04-30T06:29:59.306ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f1b5148-eb90-497e-b71a-519ad04cf27e", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78812025-04-30T06:29:59.307ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
78822025-04-30T06:29:59.307ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
78832025-04-30T06:29:59.308ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 61beb198-b158-4b61-a7db-162391acf645 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
78842025-04-30T06:29:59.309ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 61beb198-b158-4b61-a7db-162391acf645 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
78852025-04-30T06:29:59.310ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 61beb198-b158-4b61-a7db-162391acf645 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
78862025-04-30T06:29:59.311ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 61beb198-b158-4b61-a7db-162391acf645 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
78872025-04-30T06:29:59.313ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "355bd92f-0553-498b-8c1d-3ee0b18076c1", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78882025-04-30T06:29:59.313ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
78892025-04-30T06:29:59.316ZINFOtest_image_create (dropshot_internal): request completed latency_us = 8594 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 61beb198-b158-4b61-a7db-162391acf645 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
78902025-04-30T06:29:59.317ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "61beb198-b158-4b61-a7db-162391acf645", "content-length": "405", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78912025-04-30T06:29:59.317ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
78922025-04-30T06:29:59.318ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c0ace5ee-66a8-40bd-a1d7-a8c06008a5a3 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
78932025-04-30T06:29:59.319ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c0ace5ee-66a8-40bd-a1d7-a8c06008a5a3 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
78942025-04-30T06:29:59.319ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c0ace5ee-66a8-40bd-a1d7-a8c06008a5a3 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
78952025-04-30T06:29:59.320ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c0ace5ee-66a8-40bd-a1d7-a8c06008a5a3 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
78962025-04-30T06:29:59.327ZINFOtest_image_create (dropshot_internal): request completed latency_us = 8237 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c0ace5ee-66a8-40bd-a1d7-a8c06008a5a3 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
78972025-04-30T06:29:59.329ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0ace5ee-66a8-40bd-a1d7-a8c06008a5a3", "content-length": "29", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
78982025-04-30T06:29:59.329ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
78992025-04-30T06:29:59.329ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
79002025-04-30T06:29:59.329ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
79012025-04-30T06:29:59.330ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "56343c15-0a53-4af3-b54a-37f17fb6e877", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
79022025-04-30T06:29:59.331ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
79032025-04-30T06:29:59.333ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c70b5db-e99c-40be-b479-242b3eeb08cd", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
79042025-04-30T06:29:59.333ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
79052025-04-30T06:29:59.335ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
79062025-04-30T06:29:59.335ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
79072025-04-30T06:29:59.335ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
79082025-04-30T06:29:59.335ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
79092025-04-30T06:29:59.336ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
79102025-04-30T06:29:59.338ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea67352f-c7bd-43b1-adb1-fa09e4e766a5", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
79112025-04-30T06:29:59.339ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
79122025-04-30T06:29:59.339ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79132025-04-30T06:29:59.347ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
79142025-04-30T06:29:59.347ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
79152025-04-30T06:29:59.348ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
79162025-04-30T06:29:59.349ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
79172025-04-30T06:29:59.351ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b0ddee3-aff3-44e9-b3a8-e52b21e4a8f0", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:58 GMT"} })
79182025-04-30T06:29:59.354ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
79192025-04-30T06:29:59.354ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
79202025-04-30T06:29:59.354ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
79212025-04-30T06:29:59.355ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
79222025-04-30T06:29:59.357ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "763fc4fd-9a80-4255-b039-1c053e377be9", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79232025-04-30T06:29:59.358ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
79242025-04-30T06:29:59.359ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f73759dd-1425-4d71-86ff-ad9eaa3ccd80", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79252025-04-30T06:29:59.359ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
79262025-04-30T06:29:59.360ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6bcce82-b5f0-449f-a31e-d62e867a85a3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79272025-04-30T06:29:59.360ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
79282025-04-30T06:29:59.362ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "841877ee-0138-4a5a-9ae0-d9d290d9fcac", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79292025-04-30T06:29:59.362ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
79302025-04-30T06:29:59.370ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "71b33aef-f942-4870-8c34-c2c42b9e7b0e", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79312025-04-30T06:29:59.370ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
79322025-04-30T06:29:59.374ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d846aa2c-43ed-4706-8ae5-056b31eae5a8", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79332025-04-30T06:29:59.374ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
79342025-04-30T06:29:59.377ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3801ab9-d7d1-40a1-a2b7-6ade0158e2c0", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79352025-04-30T06:29:59.377ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
79362025-04-30T06:29:59.379ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc45614-6324-4618-a061-4489823dd841", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79372025-04-30T06:29:59.381ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
79382025-04-30T06:29:59.384ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e45d7507-efe9-49e4-a5be-0d6e64fc8b81", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79392025-04-30T06:29:59.384ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
79402025-04-30T06:29:59.386ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ea0ed1-7659-4a72-b94e-d839236a3b32", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79412025-04-30T06:29:59.386ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
79422025-04-30T06:29:59.389ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
79432025-04-30T06:29:59.391ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "93f2ec3e-eb1a-4a9b-a137-73972d666db8", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79442025-04-30T06:29:59.391ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
79452025-04-30T06:29:59.392ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "95e70921-9b7b-490e-a473-a7c22fc3aa4e", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79462025-04-30T06:29:59.392ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
79472025-04-30T06:29:59.393ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "084781c2-694f-43c6-abd9-45701898eb7b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79482025-04-30T06:29:59.393ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
79492025-04-30T06:29:59.394ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6af52718-c9b7-475f-a4fd-7b647ecc5883", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79502025-04-30T06:29:59.394ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
79512025-04-30T06:29:59.395ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d3fe30b-4a19-4fee-a6f5-c2c881914683", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79522025-04-30T06:29:59.395ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
79532025-04-30T06:29:59.396ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4de7e79-3f0e-4ce3-80ed-49e9f0268aad", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79542025-04-30T06:29:59.397ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
79552025-04-30T06:29:59.398ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "27db2767-ba51-463c-b4c0-6f65a6cc9ce8", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79562025-04-30T06:29:59.398ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
79572025-04-30T06:29:59.400ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "263f2437-7ad1-4d91-9d81-cf11b458a5c1", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79582025-04-30T06:29:59.400ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
79592025-04-30T06:29:59.402ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c42fd9d3-7d1b-4dc2-8a5f-0cdd386576c0", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79602025-04-30T06:29:59.402ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
79612025-04-30T06:29:59.403ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "67da27ef-dcfa-40ec-8270-be6993144aa8", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79622025-04-30T06:29:59.404ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
79632025-04-30T06:29:59.405ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "411769bf-493b-4d7b-92f9-011247899091", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79642025-04-30T06:29:59.406ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
79652025-04-30T06:29:59.407ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "935cc7d9-94dd-44e0-92cf-e61899222bae", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79662025-04-30T06:29:59.407ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
79672025-04-30T06:29:59.408ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ff601f2-e98b-4d79-b832-5015b343ab82", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79682025-04-30T06:29:59.408ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
79692025-04-30T06:29:59.410ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf8f1018-f66a-42a3-80b9-8276b6562939", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79702025-04-30T06:29:59.410ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
79712025-04-30T06:29:59.411ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3f35628-1658-4fb1-b6cc-e301c8f8d152", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79722025-04-30T06:29:59.411ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
79732025-04-30T06:29:59.412ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "474ec40d-d08c-4859-9c13-d945d1e97627", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
79742025-04-30T06:29:59.412ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
79752025-04-30T06:29:59.412ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
79762025-04-30T06:29:59.413ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
79772025-04-30T06:29:59.413ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79782025-04-30T06:29:59.419ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79792025-04-30T06:29:59.420ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
79802025-04-30T06:29:59.420ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
79812025-04-30T06:29:59.422ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
79822025-04-30T06:29:59.426ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
79832025-04-30T06:29:59.426ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
79842025-04-30T06:29:59.426ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
79852025-04-30T06:29:59.430ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79862025-04-30T06:29:59.437ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
79872025-04-30T06:29:59.437ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
79882025-04-30T06:29:59.437ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
79892025-04-30T06:29:59.438ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
79902025-04-30T06:29:59.438ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79912025-04-30T06:29:59.438ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79922025-04-30T06:29:59.440ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
79932025-04-30T06:29:59.440ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
79942025-04-30T06:29:59.440ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
79952025-04-30T06:29:59.440ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
79962025-04-30T06:29:59.441ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
79972025-04-30T06:29:59.441ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79982025-04-30T06:29:59.447ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
79992025-04-30T06:29:59.447ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
80002025-04-30T06:29:59.447ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80012025-04-30T06:29:59.447ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80022025-04-30T06:29:59.450ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80032025-04-30T06:29:59.459ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
80042025-04-30T06:29:59.459ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
80052025-04-30T06:29:59.459ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
80062025-04-30T06:29:59.461ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
80072025-04-30T06:29:59.542ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
80082025-04-30T06:29:59.542ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
80092025-04-30T06:29:59.544ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:55975 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80102025-04-30T06:29:59.545ZDEBGtest_image_create (results-sink-cluster): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80112025-04-30T06:29:59.545ZDEBGtest_image_create (results-sink): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80122025-04-30T06:29:59.546ZDEBGtest_image_create (clickhouse-client): unrolling 2 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
80132025-04-30T06:29:59.547ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
80142025-04-30T06:29:59.548ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:55975 req_id = 09ae3076-81aa-4c9a-83e5-8400cc887b8a sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
80152025-04-30T06:29:59.549ZINFOtest_image_create (dropshot): request completed latency_us = 503 local_addr = [::1]:42828 method = GET remote_addr = [::1]:55975 req_id = 09ae3076-81aa-4c9a-83e5-8400cc887b8a response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
80162025-04-30T06:29:59.549ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
80172025-04-30T06:29:59.549ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
80182025-04-30T06:29:59.550ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
80192025-04-30T06:29:59.551ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "09ae3076-81aa-4c9a-83e5-8400cc887b8a", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
80202025-04-30T06:29:59.553ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80212025-04-30T06:29:59.554ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80222025-04-30T06:29:59.554ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
80232025-04-30T06:29:59.562ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
80242025-04-30T06:29:59.562ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80252025-04-30T06:29:59.562ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
80262025-04-30T06:29:59.562ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80272025-04-30T06:29:59.563ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80282025-04-30T06:29:59.565ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
80292025-04-30T06:29:59.565ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
80302025-04-30T06:29:59.577ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80312025-04-30T06:29:59.583ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
80322025-04-30T06:29:59.583ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
80332025-04-30T06:29:59.583ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80342025-04-30T06:29:59.583ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80352025-04-30T06:29:59.585ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = measurements_i64
80362025-04-30T06:29:59.585ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80372025-04-30T06:29:59.646ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
80382025-04-30T06:29:59.652ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
80392025-04-30T06:29:59.655ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
80402025-04-30T06:29:59.655ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
80412025-04-30T06:29:59.656ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 505.857398ms iteration = 25 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
80422025-04-30T06:29:59.656ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 26 reason = Signaled
80432025-04-30T06:29:59.656ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
80442025-04-30T06:29:59.656ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80452025-04-30T06:29:59.656ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
80462025-04-30T06:29:59.656ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80472025-04-30T06:29:59.657ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80482025-04-30T06:29:59.661ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80492025-04-30T06:29:59.666ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
80502025-04-30T06:29:59.666ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
80512025-04-30T06:29:59.666ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80522025-04-30T06:29:59.669ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80532025-04-30T06:29:59.673ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
80542025-04-30T06:29:59.673ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
80552025-04-30T06:29:59.675ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 08 2f 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ./..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:63180 req_id = 47c124e1-4642-4441-9cc5-5273b9f36d8d
80562025-04-30T06:29:59.675ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2095,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63180 req_id = 47c124e1-4642-4441-9cc5-5273b9f36d8d
80572025-04-30T06:29:59.675ZDEBGtest_image_create (store): query key key = _mgs._tcp
80582025-04-30T06:29:59.675ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
80592025-04-30T06:29:59.676ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63180 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 47c124e1-4642-4441-9cc5-5273b9f36d8d
80602025-04-30T06:29:59.677ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3464, tv_nsec: 475927499 } })
80612025-04-30T06:29:59.677ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
80622025-04-30T06:29:59.677ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: cf f1 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51341 req_id = fc227327-7bea-4036-80da-d8d87e2f7148
80632025-04-30T06:29:59.677ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 53233,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51341 req_id = fc227327-7bea-4036-80da-d8d87e2f7148
80642025-04-30T06:29:59.677ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
80652025-04-30T06:29:59.677ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51341 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = fc227327-7bea-4036-80da-d8d87e2f7148
80662025-04-30T06:29:59.751ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
80672025-04-30T06:29:59.752ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
80682025-04-30T06:29:59.752ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80692025-04-30T06:29:59.752ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
80702025-04-30T06:29:59.752ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
80712025-04-30T06:29:59.754ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
80722025-04-30T06:29:59.755ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 34 40 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c 4@..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:50188 req_id = db54d054-31d8-4169-a2b5-eddd9957a4b9
80732025-04-30T06:29:59.756ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 13376,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50188 req_id = db54d054-31d8-4169-a2b5-eddd9957a4b9
80742025-04-30T06:29:59.756ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
80752025-04-30T06:29:59.756ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13376, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:50188 req_id = db54d054-31d8-4169-a2b5-eddd9957a4b9
80762025-04-30T06:29:59.757ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
80772025-04-30T06:29:59.757ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
80782025-04-30T06:29:59.757ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
80792025-04-30T06:29:59.758ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80802025-04-30T06:29:59.767ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
80812025-04-30T06:29:59.767ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
80822025-04-30T06:29:59.767ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
80832025-04-30T06:29:59.768ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
80842025-04-30T06:29:59.776ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
80852025-04-30T06:29:59.776ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
80862025-04-30T06:29:59.777ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
80872025-04-30T06:29:59.777ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "17a44ba6-0a80-41a4-aed3-c34627e91bf0", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
80882025-04-30T06:29:59.778ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
80892025-04-30T06:29:59.779ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "643f0b11-cb03-4b8c-9edd-b1abeb36ffa5", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
80902025-04-30T06:29:59.781ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
80912025-04-30T06:29:59.784ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3610b99d-b4af-4735-90a4-ea7a8d934841", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
80922025-04-30T06:29:59.784ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
80932025-04-30T06:29:59.793ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "62130807-d664-4473-907c-bdcfb2778307", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
80942025-04-30T06:29:59.794ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
80952025-04-30T06:29:59.802ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "272dffe7-0282-4c52-bc67-bf216b53cbda", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
80962025-04-30T06:29:59.803ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
80972025-04-30T06:29:59.810ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ab92b2c-9310-4929-bb22-306a79348280", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
80982025-04-30T06:29:59.811ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
80992025-04-30T06:29:59.816ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "61952c8e-fbfc-412a-8ba7-9d4254f6b860", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81002025-04-30T06:29:59.816ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
81012025-04-30T06:29:59.818ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2316365e-9f4a-4bc9-b8b8-89c8fdbd8838", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81022025-04-30T06:29:59.819ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
81032025-04-30T06:29:59.823ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
81042025-04-30T06:29:59.825ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae1287b3-060c-4d1c-ae83-3fc0babdba23", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81052025-04-30T06:29:59.825ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
81062025-04-30T06:29:59.828ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "91e26283-dffb-48c4-89c5-2ff222a99969", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81072025-04-30T06:29:59.829ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
81082025-04-30T06:29:59.832ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2038d3d5-3ad0-4c86-8d81-02a43df435b6", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81092025-04-30T06:29:59.833ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
81102025-04-30T06:29:59.835ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7a80323-bc29-4b4a-8654-360136b0394e", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81112025-04-30T06:29:59.835ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
81122025-04-30T06:29:59.838ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d12ed17-dbcb-4a26-bf87-587c164d1490", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81132025-04-30T06:29:59.838ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
81142025-04-30T06:29:59.844ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "feb3e9ce-1fe3-4df4-b1df-95ae143845e4", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81152025-04-30T06:29:59.844ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
81162025-04-30T06:29:59.849ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd74da38-41dc-4e63-adc3-bfe0a1bff434", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81172025-04-30T06:29:59.849ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
81182025-04-30T06:29:59.852ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "944e945f-980b-42a0-a143-862b7d364aef", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81192025-04-30T06:29:59.852ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
81202025-04-30T06:29:59.855ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "62c98875-3082-4d7d-8c96-57cc9785ed80", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81212025-04-30T06:29:59.855ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
81222025-04-30T06:29:59.858ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "848f5fc1-7370-404b-9fc1-6505a7e466b8", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81232025-04-30T06:29:59.858ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
81242025-04-30T06:29:59.862ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af766a79-ec63-40df-9da5-f69d01623afd", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81252025-04-30T06:29:59.862ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
81262025-04-30T06:29:59.864ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "377296e1-e4e9-40a9-a482-e8f679664065", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81272025-04-30T06:29:59.864ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
81282025-04-30T06:29:59.867ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4e5e3a7-b403-460d-8b1f-7d7f72610f6b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81292025-04-30T06:29:59.867ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
81302025-04-30T06:29:59.871ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbedd00b-6b49-4337-b2c5-ad51e0e409ea", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81312025-04-30T06:29:59.871ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
81322025-04-30T06:29:59.872ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b4e01a0-a5db-492f-b7df-190a4363ffad", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81332025-04-30T06:29:59.873ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
81342025-04-30T06:29:59.875ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
81352025-04-30T06:29:59.875ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
81362025-04-30T06:29:59.875ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
81372025-04-30T06:29:59.875ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
81382025-04-30T06:29:59.875ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
81392025-04-30T06:29:59.879ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81402025-04-30T06:29:59.886ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
81412025-04-30T06:29:59.886ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
81422025-04-30T06:29:59.886ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
81432025-04-30T06:29:59.887ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
81442025-04-30T06:29:59.887ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f9f3785-2ecc-4c33-97eb-c41e83300e5a", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81452025-04-30T06:29:59.888ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
81462025-04-30T06:29:59.891ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
81472025-04-30T06:29:59.891ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
81482025-04-30T06:29:59.892ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
81492025-04-30T06:29:59.896ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b97dbc36-bdb3-42e5-b253-55cafc377d84", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81502025-04-30T06:29:59.896ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
81512025-04-30T06:29:59.899ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "811dbe11-9c43-494f-a8d5-b22d9173cb7f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81522025-04-30T06:29:59.900ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
81532025-04-30T06:29:59.903ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eead5fa6-10fd-4183-9338-6c7b394eba43", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81542025-04-30T06:29:59.904ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
81552025-04-30T06:29:59.910ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "05cc140e-f908-4799-8cf2-2520de830299", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81562025-04-30T06:29:59.910ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
81572025-04-30T06:29:59.914ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64b592f5-1932-4ab7-9af2-47537f2f8524", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81582025-04-30T06:29:59.914ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
81592025-04-30T06:29:59.930ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c9c6bad-1285-4498-9ffb-30f36fb91a0a", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81602025-04-30T06:29:59.930ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
81612025-04-30T06:29:59.933ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
81622025-04-30T06:29:59.935ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "068d8008-6834-4c65-ab2e-185863d4474a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81632025-04-30T06:29:59.936ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
81642025-04-30T06:29:59.936ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a56c29af-f0b2-4823-bc4b-a33fcb8684a9", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81652025-04-30T06:29:59.937ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
81662025-04-30T06:29:59.938ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46efade7-6af8-4d5d-9ce5-b9b7ed508eb6", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81672025-04-30T06:29:59.938ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
81682025-04-30T06:29:59.939ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "22a5a60b-ad41-44d8-8c8b-a6e4b03e4f5c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81692025-04-30T06:29:59.939ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
81702025-04-30T06:29:59.941ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6138935a-86e3-498b-afb5-335332099dcc", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81712025-04-30T06:29:59.941ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
81722025-04-30T06:29:59.943ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd124c15-37e2-4f41-b6d5-871a29fac934", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81732025-04-30T06:29:59.943ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
81742025-04-30T06:29:59.948ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cb495ce-7cb7-4b8b-b46c-5e8322f8d2c2", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81752025-04-30T06:29:59.948ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
81762025-04-30T06:29:59.951ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "36da2434-b925-480a-9e28-561144faa5b9", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81772025-04-30T06:29:59.953ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
81782025-04-30T06:29:59.955ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "31dcc0b7-5ad0-43ff-bdec-06846b40e594", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81792025-04-30T06:29:59.955ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
81802025-04-30T06:29:59.957ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8d1a08a-5670-4351-a33d-e8f9739ac2ab", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81812025-04-30T06:29:59.957ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
81822025-04-30T06:29:59.960ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1aa0bfd-ae0d-4a00-9d42-6b2d95d96c8e", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81832025-04-30T06:29:59.961ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
81842025-04-30T06:29:59.962ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6acfbdd0-6891-4bf0-a4f7-172239ab81e4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81852025-04-30T06:29:59.962ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
81862025-04-30T06:29:59.963ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40bda909-6a12-4c9b-9025-abdc5c604b78", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81872025-04-30T06:29:59.963ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
81882025-04-30T06:29:59.964ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab7d4f80-915c-4b83-a52c-910c8c021aea", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81892025-04-30T06:29:59.964ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
81902025-04-30T06:29:59.966ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54eee39d-335a-4f38-a402-8784dccb8b31", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
81912025-04-30T06:29:59.966ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
81922025-04-30T06:29:59.966ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
81932025-04-30T06:29:59.966ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
81942025-04-30T06:29:59.966ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81952025-04-30T06:29:59.967ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81962025-04-30T06:29:59.970ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81972025-04-30T06:29:59.978ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
81982025-04-30T06:29:59.978ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
81992025-04-30T06:29:59.978ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
82002025-04-30T06:29:59.978ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
82012025-04-30T06:29:59.979ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82022025-04-30T06:29:59.980ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82032025-04-30T06:29:59.983ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82042025-04-30T06:29:59.991ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
82052025-04-30T06:29:59.991ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
82062025-04-30T06:29:59.991ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82072025-04-30T06:29:59.992ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82082025-04-30T06:29:59.993ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
82092025-04-30T06:29:59.993ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
82102025-04-30T06:29:59.993ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
82112025-04-30T06:29:59.993ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
82122025-04-30T06:29:59.994ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
82132025-04-30T06:29:59.998ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82142025-04-30T06:30:00.005ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
82152025-04-30T06:30:00.005ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
82162025-04-30T06:30:00.005ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
82172025-04-30T06:30:00.006ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
82182025-04-30T06:30:00.078ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
82192025-04-30T06:30:00.078ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
82202025-04-30T06:30:00.079ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:55698 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82212025-04-30T06:30:00.079ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:55698 req_id = d5dffe38-b9e3-4a96-ab10-bc763e307427 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
82222025-04-30T06:30:00.080ZINFOtest_image_create (dropshot): request completed latency_us = 579 local_addr = [::1]:42828 method = GET remote_addr = [::1]:55698 req_id = d5dffe38-b9e3-4a96-ab10-bc763e307427 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
82232025-04-30T06:30:00.081ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5dffe38-b9e3-4a96-ab10-bc763e307427", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
82242025-04-30T06:30:00.085ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
82252025-04-30T06:30:00.085ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
82262025-04-30T06:30:00.085ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
82272025-04-30T06:30:00.088ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
82282025-04-30T06:30:00.088ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
82292025-04-30T06:30:00.088ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
82302025-04-30T06:30:00.088ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82312025-04-30T06:30:00.089ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82322025-04-30T06:30:00.089ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
82332025-04-30T06:30:00.089ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
82342025-04-30T06:30:00.089ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
82352025-04-30T06:30:00.099ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82362025-04-30T06:30:00.104ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
82372025-04-30T06:30:00.105ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
82382025-04-30T06:30:00.106ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82392025-04-30T06:30:00.106ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82402025-04-30T06:30:00.148ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
82412025-04-30T06:30:00.151ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
82422025-04-30T06:30:00.152ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
82432025-04-30T06:30:00.152ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 496.241188ms iteration = 26 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
82442025-04-30T06:30:00.152ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 27 reason = Signaled
82452025-04-30T06:30:00.152ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
82462025-04-30T06:30:00.152ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
82472025-04-30T06:30:00.152ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
82482025-04-30T06:30:00.152ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82492025-04-30T06:30:00.154ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82502025-04-30T06:30:00.157ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82512025-04-30T06:30:00.164ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
82522025-04-30T06:30:00.164ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
82532025-04-30T06:30:00.164ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82542025-04-30T06:30:00.164ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82552025-04-30T06:30:00.167ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
82562025-04-30T06:30:00.167ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
82572025-04-30T06:30:00.168ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: ab ce 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:63313 req_id = be941cad-4d7a-4782-af29-299ff3548d35
82582025-04-30T06:30:00.168ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 43982,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63313 req_id = be941cad-4d7a-4782-af29-299ff3548d35
82592025-04-30T06:30:00.168ZDEBGtest_image_create (store): query key key = _mgs._tcp
82602025-04-30T06:30:00.169ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
82612025-04-30T06:30:00.169ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63313 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = be941cad-4d7a-4782-af29-299ff3548d35
82622025-04-30T06:30:00.169ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3464, tv_nsec: 968522441 } })
82632025-04-30T06:30:00.169ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
82642025-04-30T06:30:00.169ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ab 84 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:53771 req_id = 4998d2d3-4fdb-4f3e-b988-d5f6c242ae6b
82652025-04-30T06:30:00.170ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 43908,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:53771 req_id = 4998d2d3-4fdb-4f3e-b988-d5f6c242ae6b
82662025-04-30T06:30:00.170ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
82672025-04-30T06:30:00.170ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:53771 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 4998d2d3-4fdb-4f3e-b988-d5f6c242ae6b
82682025-04-30T06:30:00.227ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
82692025-04-30T06:30:00.227ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
82702025-04-30T06:30:00.227ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
82712025-04-30T06:30:00.227ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
82722025-04-30T06:30:00.228ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
82732025-04-30T06:30:00.229ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
82742025-04-30T06:30:00.230ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: d7 53 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .S..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:50644 req_id = 5661dd94-aca6-4ff9-b65d-66f4b6d90077
82752025-04-30T06:30:00.230ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 55123,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50644 req_id = 5661dd94-aca6-4ff9-b65d-66f4b6d90077
82762025-04-30T06:30:00.231ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
82772025-04-30T06:30:00.232ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55123, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:50644 req_id = 5661dd94-aca6-4ff9-b65d-66f4b6d90077
82782025-04-30T06:30:00.233ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
82792025-04-30T06:30:00.233ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
82802025-04-30T06:30:00.233ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
82812025-04-30T06:30:00.234ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82822025-04-30T06:30:00.242ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
82832025-04-30T06:30:00.242ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
82842025-04-30T06:30:00.242ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
82852025-04-30T06:30:00.243ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
82862025-04-30T06:30:00.246ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
82872025-04-30T06:30:00.246ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
82882025-04-30T06:30:00.246ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
82892025-04-30T06:30:00.247ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "51fb9223-efbd-40c4-a1ea-bf2b10f5bd58", "content-length": "835", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
82902025-04-30T06:30:00.248ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
82912025-04-30T06:30:00.251ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "903e7dcc-5b7e-4c3f-ad7a-89c88f4c25bf", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
82922025-04-30T06:30:00.251ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
82932025-04-30T06:30:00.255ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f89759c6-8ea7-4049-829a-f9d56379fce7", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
82942025-04-30T06:30:00.255ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
82952025-04-30T06:30:00.258ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c084675-a4b1-4231-a0f6-efcf781db9e4", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
82962025-04-30T06:30:00.258ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
82972025-04-30T06:30:00.264ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8360fcd-9186-434a-8584-13ccaeb5bfc3", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
82982025-04-30T06:30:00.264ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
82992025-04-30T06:30:00.267ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f938ea4f-b5e6-4ab6-9131-30b4cf6de096", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83002025-04-30T06:30:00.268ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
83012025-04-30T06:30:00.270ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d99fd2e8-b9a0-45f6-beb3-0674ab213792", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83022025-04-30T06:30:00.270ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
83032025-04-30T06:30:00.276ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
83042025-04-30T06:30:00.276ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee16cff3-d6c8-4705-aae9-4a7180f67c18", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83052025-04-30T06:30:00.277ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
83062025-04-30T06:30:00.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccf62a98-8dbc-403b-a85c-856d45b12278", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83072025-04-30T06:30:00.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
83082025-04-30T06:30:00.279ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b236833a-6675-498f-a779-095004d5e45f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83092025-04-30T06:30:00.279ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
83102025-04-30T06:30:00.280ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d3db73d-ea57-49c5-810a-d38e2d586cd2", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83112025-04-30T06:30:00.280ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
83122025-04-30T06:30:00.281ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2ee54fe-02c4-46cf-8cf6-1c180fffb295", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83132025-04-30T06:30:00.282ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
83142025-04-30T06:30:00.284ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "389f7d4e-f430-4b83-93d8-7fa162ab2b1a", "content-length": "734", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83152025-04-30T06:30:00.285ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
83162025-04-30T06:30:00.287ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b02ebe95-da18-4d34-810d-31e1ba3ea752", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83172025-04-30T06:30:00.287ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
83182025-04-30T06:30:00.289ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a73e6ae-7cf6-471d-a38d-258aaf0a5ddd", "content-length": "111", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83192025-04-30T06:30:00.289ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
83202025-04-30T06:30:00.293ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "29a6cdfd-a0d2-48e6-a72b-eb172d06501b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83212025-04-30T06:30:00.293ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
83222025-04-30T06:30:00.294ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c2d4b3d-7f4c-4563-b383-9c7afea59da0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83232025-04-30T06:30:00.295ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
83242025-04-30T06:30:00.296ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a1441e6-b9a7-4b8b-a5d5-5b4360dae5b0", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83252025-04-30T06:30:00.296ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
83262025-04-30T06:30:00.298ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "764d7a22-0ae1-4362-b418-5f181d45b994", "content-length": "179", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83272025-04-30T06:30:00.298ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
83282025-04-30T06:30:00.299ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "369eac35-4dd4-4446-be5d-4a849fe339d1", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83292025-04-30T06:30:00.299ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
83302025-04-30T06:30:00.300ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "517e3dae-27e9-462b-93a4-a5e5c9e6efeb", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83312025-04-30T06:30:00.301ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
83322025-04-30T06:30:00.302ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d449f59c-6026-4f04-b506-a31c79465e13", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83332025-04-30T06:30:00.302ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
83342025-04-30T06:30:00.303ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24cf286b-1c7f-49d5-ae7f-b6ce5ea5bcad", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83352025-04-30T06:30:00.303ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
83362025-04-30T06:30:00.304ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "15c1662c-4ce8-4391-a701-472187ef5cdd", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83372025-04-30T06:30:00.305ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
83382025-04-30T06:30:00.307ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f4a42d9-2ee4-4b46-bee0-e14d3365ae47", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83392025-04-30T06:30:00.307ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
83402025-04-30T06:30:00.309ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aa9c15c-5861-4f17-bb8d-521acb025b0a", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83412025-04-30T06:30:00.309ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
83422025-04-30T06:30:00.310ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2d54f8-3e1a-457d-a705-128a5035a12d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83432025-04-30T06:30:00.311ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
83442025-04-30T06:30:00.313ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f629dbf-f730-4d4f-a26b-52308c1779ba", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83452025-04-30T06:30:00.313ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
83462025-04-30T06:30:00.316ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "370eb23c-f25a-4925-935a-a47c37707ab1", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83472025-04-30T06:30:00.316ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
83482025-04-30T06:30:00.322ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f0ac476-05d6-4d7e-9b98-915093a41059", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83492025-04-30T06:30:00.322ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
83502025-04-30T06:30:00.323ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "87ec082e-e21d-4507-b38a-1744f38fae7b", "content-length": "702", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83512025-04-30T06:30:00.323ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
83522025-04-30T06:30:00.325ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3577fb7-511b-4022-ace6-71bb2f6a83e2", "content-length": "727", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83532025-04-30T06:30:00.325ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
83542025-04-30T06:30:00.327ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c95d345-9677-4073-aeb1-aeb608c222c7", "content-length": "729", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83552025-04-30T06:30:00.327ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
83562025-04-30T06:30:00.327ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
83572025-04-30T06:30:00.327ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
83582025-04-30T06:30:00.327ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
83592025-04-30T06:30:00.327ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
83602025-04-30T06:30:00.328ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
83612025-04-30T06:30:00.328ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba3bcfb4-5d14-4a22-bd96-42df668d2e90", "content-length": "728", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83622025-04-30T06:30:00.328ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
83632025-04-30T06:30:00.330ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3423365-7b3d-4232-9f90-9f3c502f30e8", "content-length": "723", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83642025-04-30T06:30:00.330ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
83652025-04-30T06:30:00.331ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83662025-04-30T06:30:00.337ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
83672025-04-30T06:30:00.338ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
83682025-04-30T06:30:00.338ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
83692025-04-30T06:30:00.338ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
83702025-04-30T06:30:00.340ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
83712025-04-30T06:30:00.340ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
83722025-04-30T06:30:00.341ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
83732025-04-30T06:30:00.341ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe8a9b37-9e3c-4256-905e-653e96746f02", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83742025-04-30T06:30:00.341ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
83752025-04-30T06:30:00.345ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "46c20335-fba5-479c-83b4-b35c2365c80c", "content-length": "109", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83762025-04-30T06:30:00.345ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
83772025-04-30T06:30:00.347ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3eea01a-bbc2-4644-a077-46996da1067b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83782025-04-30T06:30:00.347ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
83792025-04-30T06:30:00.350ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f611158f-feb7-4b06-a85c-97302b919ff1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83802025-04-30T06:30:00.350ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
83812025-04-30T06:30:00.354ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc839f8-f993-48f3-b07b-ef8c4f1c8e9d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:29:59 GMT"} })
83822025-04-30T06:30:00.355ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
83832025-04-30T06:30:00.361ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0beb7ec5-8435-4320-87ca-8c75c18caeae", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
83842025-04-30T06:30:00.361ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
83852025-04-30T06:30:00.362ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "11100f24-b7ea-43cc-8049-23ffdf2e0e00", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
83862025-04-30T06:30:00.364ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
83872025-04-30T06:30:00.365ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a85f401e-d452-4292-95f0-a0e4d3a6f0c0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
83882025-04-30T06:30:00.366ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
83892025-04-30T06:30:00.367ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b57eead-82be-4243-bb50-88932cd6eab8", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
83902025-04-30T06:30:00.367ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
83912025-04-30T06:30:00.368ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a23d29e2-dca4-4256-a1da-7ba57d67b201", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
83922025-04-30T06:30:00.368ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
83932025-04-30T06:30:00.368ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
83942025-04-30T06:30:00.368ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
83952025-04-30T06:30:00.368ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
83962025-04-30T06:30:00.369ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
83972025-04-30T06:30:00.374ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83982025-04-30T06:30:00.390ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
83992025-04-30T06:30:00.391ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
84002025-04-30T06:30:00.391ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84012025-04-30T06:30:00.391ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
84022025-04-30T06:30:00.391ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84032025-04-30T06:30:00.392ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84042025-04-30T06:30:00.393ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
84052025-04-30T06:30:00.395ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84062025-04-30T06:30:00.402ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
84072025-04-30T06:30:00.402ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
84082025-04-30T06:30:00.402ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84092025-04-30T06:30:00.403ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84102025-04-30T06:30:00.479ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
84112025-04-30T06:30:00.479ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
84122025-04-30T06:30:00.480ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
84132025-04-30T06:30:00.480ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84142025-04-30T06:30:00.480ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
84152025-04-30T06:30:00.480ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
84162025-04-30T06:30:00.482ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
84172025-04-30T06:30:00.482ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:57717 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84182025-04-30T06:30:00.483ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
84192025-04-30T06:30:00.483ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
84202025-04-30T06:30:00.484ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:57717 req_id = b859f2bd-6e08-4bd9-b14a-539266c0b9cd sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
84212025-04-30T06:30:00.486ZINFOtest_image_create (dropshot): request completed latency_us = 2080 local_addr = [::1]:42828 method = GET remote_addr = [::1]:57717 req_id = b859f2bd-6e08-4bd9-b14a-539266c0b9cd response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
84222025-04-30T06:30:00.487ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
84232025-04-30T06:30:00.489ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
84242025-04-30T06:30:00.489ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
84252025-04-30T06:30:00.490ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
84262025-04-30T06:30:00.490ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b859f2bd-6e08-4bd9-b14a-539266c0b9cd", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
84272025-04-30T06:30:00.493ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
84282025-04-30T06:30:00.493ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
84292025-04-30T06:30:00.493ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
84302025-04-30T06:30:00.495ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
84312025-04-30T06:30:00.495ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84322025-04-30T06:30:00.495ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
84332025-04-30T06:30:00.495ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84342025-04-30T06:30:00.496ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84352025-04-30T06:30:00.497ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84362025-04-30T06:30:00.502ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
84372025-04-30T06:30:00.502ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
84382025-04-30T06:30:00.502ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
84392025-04-30T06:30:00.503ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
84402025-04-30T06:30:00.505ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84412025-04-30T06:30:00.509ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
84422025-04-30T06:30:00.509ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
84432025-04-30T06:30:00.509ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84442025-04-30T06:30:00.510ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84452025-04-30T06:30:00.518ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
84462025-04-30T06:30:00.518ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
84472025-04-30T06:30:00.519ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
84482025-04-30T06:30:00.520ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
84492025-04-30T06:30:00.520ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
84502025-04-30T06:30:00.521ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
84512025-04-30T06:30:00.523ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
84522025-04-30T06:30:00.537ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
84532025-04-30T06:30:00.537ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
84542025-04-30T06:30:00.543ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
84552025-04-30T06:30:00.543ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
84562025-04-30T06:30:00.589ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
84572025-04-30T06:30:00.589ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
84582025-04-30T06:30:00.589ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 437.241255ms iteration = 27 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
84592025-04-30T06:30:00.589ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 28 reason = Signaled
84602025-04-30T06:30:00.589ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
84612025-04-30T06:30:00.589ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84622025-04-30T06:30:00.589ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
84632025-04-30T06:30:00.589ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84642025-04-30T06:30:00.590ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84652025-04-30T06:30:00.591ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
84662025-04-30T06:30:00.594ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84672025-04-30T06:30:00.598ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
84682025-04-30T06:30:00.598ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
84692025-04-30T06:30:00.598ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84702025-04-30T06:30:00.599ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84712025-04-30T06:30:00.602ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
84722025-04-30T06:30:00.602ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
84732025-04-30T06:30:00.604ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 87 83 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:50435 req_id = 18069f56-f76b-4622-a057-5abd301f5831
84742025-04-30T06:30:00.604ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 34691,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50435 req_id = 18069f56-f76b-4622-a057-5abd301f5831
84752025-04-30T06:30:00.604ZDEBGtest_image_create (store): query key key = _mgs._tcp
84762025-04-30T06:30:00.605ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
84772025-04-30T06:30:00.605ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:50435 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 18069f56-f76b-4622-a057-5abd301f5831
84782025-04-30T06:30:00.605ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3465, tv_nsec: 404738213 } })
84792025-04-30T06:30:00.605ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
84802025-04-30T06:30:00.606ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: dd 43 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .C..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:50828 req_id = 0a6bbb1e-680a-465d-a3c7-ded972daa0f4
84812025-04-30T06:30:00.606ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56643,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50828 req_id = 0a6bbb1e-680a-465d-a3c7-ded972daa0f4
84822025-04-30T06:30:00.606ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
84832025-04-30T06:30:00.606ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:50828 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 0a6bbb1e-680a-465d-a3c7-ded972daa0f4
84842025-04-30T06:30:00.667ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
84852025-04-30T06:30:00.668ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
84862025-04-30T06:30:00.668ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84872025-04-30T06:30:00.668ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
84882025-04-30T06:30:00.668ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
84892025-04-30T06:30:00.669ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
84902025-04-30T06:30:00.669ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
84912025-04-30T06:30:00.670ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 06 8e 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:63121 req_id = d9e79a5f-49b5-48e3-9d31-07662f9c84fb
84922025-04-30T06:30:00.670ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1678,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63121 req_id = d9e79a5f-49b5-48e3-9d31-07662f9c84fb
84932025-04-30T06:30:00.670ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
84942025-04-30T06:30:00.671ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1678, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:63121 req_id = d9e79a5f-49b5-48e3-9d31-07662f9c84fb
84952025-04-30T06:30:00.671ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
84962025-04-30T06:30:00.671ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
84972025-04-30T06:30:00.671ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
84982025-04-30T06:30:00.672ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84992025-04-30T06:30:00.680ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
85002025-04-30T06:30:00.680ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
85012025-04-30T06:30:00.680ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
85022025-04-30T06:30:00.681ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
85032025-04-30T06:30:00.688ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
85042025-04-30T06:30:00.688ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
85052025-04-30T06:30:00.691ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
85062025-04-30T06:30:00.692ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "3578201d-5bc1-4566-9e7e-1000aa453e16", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85072025-04-30T06:30:00.692ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
85082025-04-30T06:30:00.694ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fe43602-6aa5-42ac-8bb5-78f229afacd8", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85092025-04-30T06:30:00.694ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
85102025-04-30T06:30:00.697ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d469e5c0-5690-4586-91d6-994ec22ae610", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85112025-04-30T06:30:00.698ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
85122025-04-30T06:30:00.702ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1513c577-0989-47f4-8174-ae6169ff21d6", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85132025-04-30T06:30:00.702ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
85142025-04-30T06:30:00.705ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d149867-bfdd-4e73-8f68-d58b09a497c7", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85152025-04-30T06:30:00.705ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
85162025-04-30T06:30:00.711ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "093fe71c-7c1e-4620-b9c5-7988652599b5", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85172025-04-30T06:30:00.712ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
85182025-04-30T06:30:00.716ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eef7716-b98e-49b1-9c15-1950f6feadaa", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85192025-04-30T06:30:00.716ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
85202025-04-30T06:30:00.720ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4a401e2-2c50-4bf3-9f57-b25ca8359cf2", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85212025-04-30T06:30:00.720ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
85222025-04-30T06:30:00.722ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d243cce-0b63-44c8-a0d0-ffa791fcdd81", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85232025-04-30T06:30:00.723ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
85242025-04-30T06:30:00.725ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ff421d2-901f-4cf9-93d0-bb7ef2796aa7", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85252025-04-30T06:30:00.725ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
85262025-04-30T06:30:00.727ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b11f591-81b7-4db1-96c8-f0f06d23d2d7", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85272025-04-30T06:30:00.727ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
85282025-04-30T06:30:00.730ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dbf8590-0c4b-449d-9f13-ae5d4609e527", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85292025-04-30T06:30:00.730ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
85302025-04-30T06:30:00.731ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
85312025-04-30T06:30:00.733ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdda6ee2-b984-4267-b9a3-506065d09938", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85322025-04-30T06:30:00.733ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
85332025-04-30T06:30:00.735ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cf3ebcc-dded-4656-b32a-9b9ad846e6e1", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85342025-04-30T06:30:00.735ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
85352025-04-30T06:30:00.738ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f4c043-2260-4850-837d-3527a8b66342", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85362025-04-30T06:30:00.738ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
85372025-04-30T06:30:00.741ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "93f8e491-0d4e-4201-afa9-1f73dd866b38", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85382025-04-30T06:30:00.742ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
85392025-04-30T06:30:00.747ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8021562e-bfdd-4e48-a3b9-e70a7f8025d0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85402025-04-30T06:30:00.748ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
85412025-04-30T06:30:00.752ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cb9659a-b867-4f20-879f-2c906258c081", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85422025-04-30T06:30:00.753ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
85432025-04-30T06:30:00.755ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b02674-c46c-47ca-88fc-5e824c58c9e9", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85442025-04-30T06:30:00.755ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
85452025-04-30T06:30:00.756ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a128b8c-841d-4f1e-8c26-85aa5c8ba363", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85462025-04-30T06:30:00.757ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
85472025-04-30T06:30:00.758ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "21342400-19ad-4b09-b28a-3c9fb5b7ba7f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85482025-04-30T06:30:00.759ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
85492025-04-30T06:30:00.760ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed222c37-9c33-4415-92b9-3ca3a6819a88", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85502025-04-30T06:30:00.760ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
85512025-04-30T06:30:00.761ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fb54a46-d765-4e08-bc79-cc3522105dcd", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85522025-04-30T06:30:00.761ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
85532025-04-30T06:30:00.764ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "acec0535-9593-4e80-a708-7726ccaaf84d", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85542025-04-30T06:30:00.764ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
85552025-04-30T06:30:00.766ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fa9ac68-b248-47d9-810c-11fc5eb4160f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85562025-04-30T06:30:00.766ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
85572025-04-30T06:30:00.769ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aee5b41b-dbeb-427e-bfe4-2916e740cc3c", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85582025-04-30T06:30:00.769ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
85592025-04-30T06:30:00.773ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64260bc0-be87-4acb-8a29-c6b06d51a822", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85602025-04-30T06:30:00.773ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
85612025-04-30T06:30:00.776ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2768b7a9-0141-462a-b598-120a45809a94", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85622025-04-30T06:30:00.776ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
85632025-04-30T06:30:00.779ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd6b5637-6732-4244-aac9-ec7119995206", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85642025-04-30T06:30:00.779ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
85652025-04-30T06:30:00.782ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
85662025-04-30T06:30:00.782ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
85672025-04-30T06:30:00.782ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
85682025-04-30T06:30:00.782ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
85692025-04-30T06:30:00.783ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
85702025-04-30T06:30:00.783ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "476dc482-4ffa-4b06-9ba4-77fe52c4f723", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85712025-04-30T06:30:00.784ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
85722025-04-30T06:30:00.785ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8dbba61-2521-4c46-a21a-83d881dabb39", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85732025-04-30T06:30:00.785ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
85742025-04-30T06:30:00.786ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85752025-04-30T06:30:00.792ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
85762025-04-30T06:30:00.792ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
85772025-04-30T06:30:00.792ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
85782025-04-30T06:30:00.793ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
85792025-04-30T06:30:00.794ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0725d4c4-0adf-43ab-9f1f-7b1fda2aaa7f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85802025-04-30T06:30:00.794ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
85812025-04-30T06:30:00.796ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
85822025-04-30T06:30:00.796ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
85832025-04-30T06:30:00.796ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
85842025-04-30T06:30:00.798ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ced4eb76-509a-4eaa-83e7-74aa5a2ed9d3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85852025-04-30T06:30:00.798ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
85862025-04-30T06:30:00.801ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "472f03b4-d4f2-42ca-9ba8-9a20eaea1ced", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85872025-04-30T06:30:00.802ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
85882025-04-30T06:30:00.805ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dfb9255-8030-4fa5-847f-6f4221e42fee", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85892025-04-30T06:30:00.806ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
85902025-04-30T06:30:00.808ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "785577e5-f3c6-45b9-bdff-67db59a0cadb", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85912025-04-30T06:30:00.809ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
85922025-04-30T06:30:00.813ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eccd86c-7488-4e3c-85e9-248c70eb8417", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85932025-04-30T06:30:00.813ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
85942025-04-30T06:30:00.815ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c87b96b-b223-4726-b2e4-bb7c9c12e67a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85952025-04-30T06:30:00.815ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
85962025-04-30T06:30:00.819ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "651e5698-9e43-40d0-917f-c7d375126f36", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85972025-04-30T06:30:00.819ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
85982025-04-30T06:30:00.821ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b97df6fd-5704-4dc9-834a-23da37920707", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
85992025-04-30T06:30:00.822ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
86002025-04-30T06:30:00.824ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5863cb2e-09fa-4082-854a-5e30cefc98c1", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
86012025-04-30T06:30:00.824ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
86022025-04-30T06:30:00.826ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
86032025-04-30T06:30:00.827ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fe4aca4-ab53-4a98-9d95-c74e3d1adbea", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
86042025-04-30T06:30:00.827ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
86052025-04-30T06:30:00.830ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f260798b-c7c1-44f4-b2fe-9efdd8299788", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
86062025-04-30T06:30:00.830ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
86072025-04-30T06:30:00.831ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "87d5b4ce-cdd8-4517-a72f-b0fd5df4bdc0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
86082025-04-30T06:30:00.831ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
86092025-04-30T06:30:00.833ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed479f2c-a2fe-4b2d-8182-1f1729098ea3", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
86102025-04-30T06:30:00.833ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
86112025-04-30T06:30:00.833ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86122025-04-30T06:30:00.833ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
86132025-04-30T06:30:00.833ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86142025-04-30T06:30:00.834ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86152025-04-30T06:30:00.837ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86162025-04-30T06:30:00.843ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
86172025-04-30T06:30:00.844ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
86182025-04-30T06:30:00.844ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86192025-04-30T06:30:00.844ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
86202025-04-30T06:30:00.844ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86212025-04-30T06:30:00.844ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86222025-04-30T06:30:00.847ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86232025-04-30T06:30:00.870ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
86242025-04-30T06:30:00.870ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
86252025-04-30T06:30:00.870ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86262025-04-30T06:30:00.871ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86272025-04-30T06:30:00.881ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
86282025-04-30T06:30:00.881ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86292025-04-30T06:30:00.881ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
86302025-04-30T06:30:00.881ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
86312025-04-30T06:30:00.881ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
86322025-04-30T06:30:00.979ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
86332025-04-30T06:30:00.979ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
86342025-04-30T06:30:00.980ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86352025-04-30T06:30:00.990ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
86362025-04-30T06:30:00.990ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
86372025-04-30T06:30:00.990ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
86382025-04-30T06:30:00.990ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
86392025-04-30T06:30:00.990ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:62094 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
86402025-04-30T06:30:00.992ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:62094 req_id = bdd25c9e-b3d8-4e75-99f6-e6a8eadac573 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
86412025-04-30T06:30:00.993ZINFOtest_image_create (dropshot): request completed latency_us = 439 local_addr = [::1]:42828 method = GET remote_addr = [::1]:62094 req_id = bdd25c9e-b3d8-4e75-99f6-e6a8eadac573 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
86422025-04-30T06:30:00.994ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdd25c9e-b3d8-4e75-99f6-e6a8eadac573", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
86432025-04-30T06:30:00.997ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
86442025-04-30T06:30:00.997ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
86452025-04-30T06:30:00.997ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
86462025-04-30T06:30:01.001ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
86472025-04-30T06:30:01.001ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86482025-04-30T06:30:01.001ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
86492025-04-30T06:30:01.001ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86502025-04-30T06:30:01.001ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86512025-04-30T06:30:01.002ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
86522025-04-30T06:30:01.002ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
86532025-04-30T06:30:01.002ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
86542025-04-30T06:30:01.005ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86552025-04-30T06:30:01.012ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
86562025-04-30T06:30:01.012ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
86572025-04-30T06:30:01.012ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86582025-04-30T06:30:01.013ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86592025-04-30T06:30:01.091ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
86602025-04-30T06:30:01.095ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
86612025-04-30T06:30:01.095ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
86622025-04-30T06:30:01.096ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 506.583474ms iteration = 28 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
86632025-04-30T06:30:01.096ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 29 reason = Signaled
86642025-04-30T06:30:01.096ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
86652025-04-30T06:30:01.096ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86662025-04-30T06:30:01.096ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
86672025-04-30T06:30:01.096ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86682025-04-30T06:30:01.097ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86692025-04-30T06:30:01.101ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86702025-04-30T06:30:01.108ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
86712025-04-30T06:30:01.108ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
86722025-04-30T06:30:01.108ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86732025-04-30T06:30:01.109ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86742025-04-30T06:30:01.113ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
86752025-04-30T06:30:01.113ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
86762025-04-30T06:30:01.114ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: c1 98 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:53977 req_id = cab49aea-4534-455c-abe3-477e10dfb406
86772025-04-30T06:30:01.114ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49560,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:53977 req_id = cab49aea-4534-455c-abe3-477e10dfb406
86782025-04-30T06:30:01.114ZDEBGtest_image_create (store): query key key = _mgs._tcp
86792025-04-30T06:30:01.114ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
86802025-04-30T06:30:01.115ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:53977 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = cab49aea-4534-455c-abe3-477e10dfb406
86812025-04-30T06:30:01.115ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3465, tv_nsec: 914323538 } })
86822025-04-30T06:30:01.115ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
86832025-04-30T06:30:01.115ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 40 09 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e @...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:65183 req_id = 0ba4c0a9-3cd7-4d92-bee1-3ef929abb274
86842025-04-30T06:30:01.116ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 16393,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65183 req_id = 0ba4c0a9-3cd7-4d92-bee1-3ef929abb274
86852025-04-30T06:30:01.116ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
86862025-04-30T06:30:01.116ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:65183 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 0ba4c0a9-3cd7-4d92-bee1-3ef929abb274
86872025-04-30T06:30:01.192ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
86882025-04-30T06:30:01.193ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
86892025-04-30T06:30:01.193ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86902025-04-30T06:30:01.193ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
86912025-04-30T06:30:01.193ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
86922025-04-30T06:30:01.194ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
86932025-04-30T06:30:01.197ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 37 e6 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c 7............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:52343 req_id = b4628c37-3036-4ae7-b807-6c8ed3c57c04
86942025-04-30T06:30:01.197ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 14310,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52343 req_id = b4628c37-3036-4ae7-b807-6c8ed3c57c04
86952025-04-30T06:30:01.197ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
86962025-04-30T06:30:01.197ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14310, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:52343 req_id = b4628c37-3036-4ae7-b807-6c8ed3c57c04
86972025-04-30T06:30:01.197ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
86982025-04-30T06:30:01.197ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
86992025-04-30T06:30:01.197ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
87002025-04-30T06:30:01.202ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "28443ff0-a033-4a12-b0fc-492096def7fd", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87012025-04-30T06:30:01.202ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
87022025-04-30T06:30:01.203ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87032025-04-30T06:30:01.211ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
87042025-04-30T06:30:01.211ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
87052025-04-30T06:30:01.211ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
87062025-04-30T06:30:01.211ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
87072025-04-30T06:30:01.214ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7fe4f0d-ef4b-4263-8368-3884ac88fcf7", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87082025-04-30T06:30:01.215ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
87092025-04-30T06:30:01.215ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
87102025-04-30T06:30:01.215ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
87112025-04-30T06:30:01.217ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
87122025-04-30T06:30:01.223ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2842a962-faf4-4566-9395-9e96ec63877d", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87132025-04-30T06:30:01.223ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
87142025-04-30T06:30:01.226ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "baec51e4-ed90-4c60-9ded-679cce6440ba", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87152025-04-30T06:30:01.226ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
87162025-04-30T06:30:01.228ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d44392f7-3858-4079-9d70-b706220c2a68", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87172025-04-30T06:30:01.228ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
87182025-04-30T06:30:01.232ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "46370200-e8b3-4578-9542-ee7606ecb39f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87192025-04-30T06:30:01.232ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
87202025-04-30T06:30:01.236ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b55e7669-1713-46a9-8840-d23bca24565e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87212025-04-30T06:30:01.236ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
87222025-04-30T06:30:01.239ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b97ac05-dbe7-4e1e-ae61-2937b797c410", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87232025-04-30T06:30:01.239ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
87242025-04-30T06:30:01.241ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "55c3d33b-16c8-450d-8846-d34c914f6498", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87252025-04-30T06:30:01.241ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
87262025-04-30T06:30:01.243ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d198dc6-c1f8-4cab-92c4-d6e055079d3b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87272025-04-30T06:30:01.243ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
87282025-04-30T06:30:01.248ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd9dc53a-a22f-4447-9bfe-f37a48f3c102", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87292025-04-30T06:30:01.249ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
87302025-04-30T06:30:01.250ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
87312025-04-30T06:30:01.252ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5843751-2389-4502-b112-5642043a00a3", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87322025-04-30T06:30:01.252ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
87332025-04-30T06:30:01.254ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f908c20-f1d3-44b0-a526-de78af6771b9", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87342025-04-30T06:30:01.256ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
87352025-04-30T06:30:01.260ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7a6ce85-5309-4d77-b748-322319f272f4", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87362025-04-30T06:30:01.260ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
87372025-04-30T06:30:01.262ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "69be8063-8083-478a-8297-4fb51dc3191b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87382025-04-30T06:30:01.263ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
87392025-04-30T06:30:01.266ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ea197a3-9f1d-4e2d-93c8-77f135f1c611", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87402025-04-30T06:30:01.266ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
87412025-04-30T06:30:01.269ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3136f47a-c681-4b40-8374-5952a9b8f8b5", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87422025-04-30T06:30:01.269ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
87432025-04-30T06:30:01.271ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2b94e0d-657c-41d3-93a1-0d0aa540bf3d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87442025-04-30T06:30:01.271ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
87452025-04-30T06:30:01.273ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dce3b03-6bfd-4ede-b3cc-70f62c04126e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87462025-04-30T06:30:01.273ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
87472025-04-30T06:30:01.274ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "437f56a7-5be9-4919-88cf-b5d502fb2d6b", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87482025-04-30T06:30:01.274ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
87492025-04-30T06:30:01.276ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "647e1c68-f842-4877-8714-a3da39369817", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87502025-04-30T06:30:01.277ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
87512025-04-30T06:30:01.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "29cada46-10ee-48d5-932a-1671a254ff5a", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87522025-04-30T06:30:01.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
87532025-04-30T06:30:01.280ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6972b4fb-c695-43a6-abce-b5d56959ff23", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87542025-04-30T06:30:01.280ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
87552025-04-30T06:30:01.283ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c353dc70-b4f9-4d16-b52a-6a8e49e2ba7e", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87562025-04-30T06:30:01.283ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
87572025-04-30T06:30:01.285ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "649bb6ec-1d0b-4bf8-b286-cf9283d9a8e9", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87582025-04-30T06:30:01.285ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
87592025-04-30T06:30:01.288ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b702ca7-29fd-40ac-a36a-6ebebd69755b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87602025-04-30T06:30:01.288ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
87612025-04-30T06:30:01.291ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "071c2dc7-8fc4-4f91-856c-65483faf63ae", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87622025-04-30T06:30:01.292ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
87632025-04-30T06:30:01.297ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf73765b-556f-4623-b57d-dae1d3e0ca82", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87642025-04-30T06:30:01.300ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
87652025-04-30T06:30:01.301ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
87662025-04-30T06:30:01.301ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
87672025-04-30T06:30:01.301ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
87682025-04-30T06:30:01.301ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
87692025-04-30T06:30:01.302ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
87702025-04-30T06:30:01.305ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87712025-04-30T06:30:01.314ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
87722025-04-30T06:30:01.314ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
87732025-04-30T06:30:01.314ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
87742025-04-30T06:30:01.314ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
87752025-04-30T06:30:01.315ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "10476895-32dd-481a-b96f-4e866293bb89", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87762025-04-30T06:30:01.315ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
87772025-04-30T06:30:01.317ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
87782025-04-30T06:30:01.318ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87792025-04-30T06:30:01.318ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 87c2e8b0-93e3-4348-9964-ca5844de3366 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87802025-04-30T06:30:01.319ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 87c2e8b0-93e3-4348-9964-ca5844de3366 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87812025-04-30T06:30:01.319ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 87c2e8b0-93e3-4348-9964-ca5844de3366 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87822025-04-30T06:30:01.322ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 87c2e8b0-93e3-4348-9964-ca5844de3366 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87832025-04-30T06:30:01.322ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
87842025-04-30T06:30:01.322ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
87852025-04-30T06:30:01.322ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
87862025-04-30T06:30:01.326ZINFOtest_image_create (dropshot_internal): request completed latency_us = 7953 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 87c2e8b0-93e3-4348-9964-ca5844de3366 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87872025-04-30T06:30:01.326ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "87c2e8b0-93e3-4348-9964-ca5844de3366", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87882025-04-30T06:30:01.327ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87892025-04-30T06:30:01.330ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f07bd890-e532-46dd-ad46-e84441e49c63 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87902025-04-30T06:30:01.330ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f07bd890-e532-46dd-ad46-e84441e49c63 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87912025-04-30T06:30:01.330ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f07bd890-e532-46dd-ad46-e84441e49c63 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87922025-04-30T06:30:01.332ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f07bd890-e532-46dd-ad46-e84441e49c63 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87932025-04-30T06:30:01.334ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "98837624-d6da-4e15-ac02-f39a4209b1a5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87942025-04-30T06:30:01.338ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
87952025-04-30T06:30:01.339ZINFOtest_image_create (dropshot_internal): request completed latency_us = 9405 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = f07bd890-e532-46dd-ad46-e84441e49c63 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87962025-04-30T06:30:01.342ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "f07bd890-e532-46dd-ad46-e84441e49c63", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
87972025-04-30T06:30:01.342ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
87982025-04-30T06:30:01.342ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
87992025-04-30T06:30:01.342ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
88002025-04-30T06:30:01.343ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56ac2f9e-4002-4c93-975f-ee0baeb5777a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
88012025-04-30T06:30:01.344ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
88022025-04-30T06:30:01.349ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "98be4902-2f9b-4091-905b-ef7529797e61", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
88032025-04-30T06:30:01.349ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
88042025-04-30T06:30:01.352ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f167387f-21c1-49fc-a8a0-163c8c015749", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
88052025-04-30T06:30:01.352ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
88062025-04-30T06:30:01.353ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c98fd2ba-cf9d-44c5-9815-0427f005baca", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
88072025-04-30T06:30:01.354ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
88082025-04-30T06:30:01.355ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec5cd0fb-993c-42ad-8d36-0509fc2e7d75", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:00 GMT"} })
88092025-04-30T06:30:01.356ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
88102025-04-30T06:30:01.358ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b9414e1-3819-4f78-9a91-7f81967099b3", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88112025-04-30T06:30:01.359ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
88122025-04-30T06:30:01.361ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bcdf4da-a862-451b-b57d-64212a55d919", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88132025-04-30T06:30:01.361ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
88142025-04-30T06:30:01.364ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6210979f-6fa2-40df-a1af-243d4f87691a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88152025-04-30T06:30:01.365ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
88162025-04-30T06:30:01.369ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "93f13d01-a50c-4d03-8728-3807fadbb636", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88172025-04-30T06:30:01.369ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
88182025-04-30T06:30:01.370ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
88192025-04-30T06:30:01.372ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f38d35d8-8ebb-4cf8-ada9-8672912af1a1", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88202025-04-30T06:30:01.373ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
88212025-04-30T06:30:01.381ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "332225d2-8c4e-4256-afbc-08e8028b28b8", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88222025-04-30T06:30:01.382ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
88232025-04-30T06:30:01.382ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "237d4ec4-8403-4b4d-bf14-f1d0d3006644", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88242025-04-30T06:30:01.383ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
88252025-04-30T06:30:01.385ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e9a7f21-2e2a-4b42-a29c-0b6cffc200a6", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88262025-04-30T06:30:01.385ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
88272025-04-30T06:30:01.387ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cdb5945-9d19-4aa7-a76b-f7ada83ca0ac", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88282025-04-30T06:30:01.388ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
88292025-04-30T06:30:01.392ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f08535-5d81-4220-98d9-9e2fe40db1ba", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88302025-04-30T06:30:01.392ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
88312025-04-30T06:30:01.392ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88322025-04-30T06:30:01.392ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
88332025-04-30T06:30:01.392ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88342025-04-30T06:30:01.394ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88352025-04-30T06:30:01.398ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88362025-04-30T06:30:01.407ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
88372025-04-30T06:30:01.407ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
88382025-04-30T06:30:01.407ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88392025-04-30T06:30:01.407ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
88402025-04-30T06:30:01.407ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88412025-04-30T06:30:01.408ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88422025-04-30T06:30:01.413ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88432025-04-30T06:30:01.417ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
88442025-04-30T06:30:01.417ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
88452025-04-30T06:30:01.417ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88462025-04-30T06:30:01.417ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88472025-04-30T06:30:01.418ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
88482025-04-30T06:30:01.418ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
88492025-04-30T06:30:01.420ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
88502025-04-30T06:30:01.424ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
88512025-04-30T06:30:01.424ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
88522025-04-30T06:30:01.424ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
88532025-04-30T06:30:01.532ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
88542025-04-30T06:30:01.532ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
88552025-04-30T06:30:01.533ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
88562025-04-30T06:30:01.533ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88572025-04-30T06:30:01.533ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
88582025-04-30T06:30:01.533ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
88592025-04-30T06:30:01.535ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
88602025-04-30T06:30:01.535ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:48190 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
88612025-04-30T06:30:01.540ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88622025-04-30T06:30:01.542ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88632025-04-30T06:30:01.542ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
88642025-04-30T06:30:01.544ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
88652025-04-30T06:30:01.545ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:48190 req_id = 6af05b81-e661-495b-a3cc-90a7fe6f4190 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
88662025-04-30T06:30:01.547ZINFOtest_image_create (dropshot): request completed latency_us = 1902 local_addr = [::1]:42828 method = GET remote_addr = [::1]:48190 req_id = 6af05b81-e661-495b-a3cc-90a7fe6f4190 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
88672025-04-30T06:30:01.548ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88682025-04-30T06:30:01.563ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
88692025-04-30T06:30:01.563ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
88702025-04-30T06:30:01.563ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
88712025-04-30T06:30:01.564ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
88722025-04-30T06:30:01.567ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "6af05b81-e661-495b-a3cc-90a7fe6f4190", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
88732025-04-30T06:30:01.570ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
88742025-04-30T06:30:01.570ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
88752025-04-30T06:30:01.570ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
88762025-04-30T06:30:01.573ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
88772025-04-30T06:30:01.573ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88782025-04-30T06:30:01.573ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
88792025-04-30T06:30:01.573ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88802025-04-30T06:30:01.574ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88812025-04-30T06:30:01.576ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
88822025-04-30T06:30:01.577ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
88832025-04-30T06:30:01.584ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
88842025-04-30T06:30:01.584ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
88852025-04-30T06:30:01.585ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
88862025-04-30T06:30:01.585ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88872025-04-30T06:30:01.592ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
88882025-04-30T06:30:01.593ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
88892025-04-30T06:30:01.593ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88902025-04-30T06:30:01.594ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88912025-04-30T06:30:01.598ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
88922025-04-30T06:30:01.598ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88932025-04-30T06:30:01.643ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
88942025-04-30T06:30:01.651ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
88952025-04-30T06:30:01.653ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
88962025-04-30T06:30:01.654ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 557.101709ms iteration = 29 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
88972025-04-30T06:30:01.654ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 30 reason = Signaled
88982025-04-30T06:30:01.654ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
88992025-04-30T06:30:01.655ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89002025-04-30T06:30:01.655ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
89012025-04-30T06:30:01.655ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89022025-04-30T06:30:01.657ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89032025-04-30T06:30:01.666ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
89042025-04-30T06:30:01.667ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89052025-04-30T06:30:01.672ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
89062025-04-30T06:30:01.672ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
89072025-04-30T06:30:01.672ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89082025-04-30T06:30:01.673ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89092025-04-30T06:30:01.679ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
89102025-04-30T06:30:01.679ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
89112025-04-30T06:30:01.684ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: ed b4 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:56494 req_id = 73d02d27-455e-41bc-ae7d-44d6d8a25fe8
89122025-04-30T06:30:01.684ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60852,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56494 req_id = 73d02d27-455e-41bc-ae7d-44d6d8a25fe8
89132025-04-30T06:30:01.684ZDEBGtest_image_create (store): query key key = _mgs._tcp
89142025-04-30T06:30:01.684ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
89152025-04-30T06:30:01.685ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:56494 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 73d02d27-455e-41bc-ae7d-44d6d8a25fe8
89162025-04-30T06:30:01.685ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3466, tv_nsec: 484336532 } })
89172025-04-30T06:30:01.685ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
89182025-04-30T06:30:01.686ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 08 ae 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:54801 req_id = cb11d88b-e30e-4a4e-8f38-bd71eff12962
89192025-04-30T06:30:01.686ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2222,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54801 req_id = cb11d88b-e30e-4a4e-8f38-bd71eff12962
89202025-04-30T06:30:01.686ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
89212025-04-30T06:30:01.686ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:54801 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = cb11d88b-e30e-4a4e-8f38-bd71eff12962
89222025-04-30T06:30:01.784ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
89232025-04-30T06:30:01.785ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
89242025-04-30T06:30:01.785ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89252025-04-30T06:30:01.785ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
89262025-04-30T06:30:01.785ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
89272025-04-30T06:30:01.786ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
89282025-04-30T06:30:01.787ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: c9 68 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .h..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:54593 req_id = a750b9c1-6f72-4874-b5fa-7749698b436a
89292025-04-30T06:30:01.787ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 51560,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54593 req_id = a750b9c1-6f72-4874-b5fa-7749698b436a
89302025-04-30T06:30:01.787ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
89312025-04-30T06:30:01.788ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51560, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:54593 req_id = a750b9c1-6f72-4874-b5fa-7749698b436a
89322025-04-30T06:30:01.791ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
89332025-04-30T06:30:01.791ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
89342025-04-30T06:30:01.792ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
89352025-04-30T06:30:01.794ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362025-04-30T06:30:01.808ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
89372025-04-30T06:30:01.808ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
89382025-04-30T06:30:01.808ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
89392025-04-30T06:30:01.809ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
89402025-04-30T06:30:01.811ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
89412025-04-30T06:30:01.811ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
89422025-04-30T06:30:01.814ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
89432025-04-30T06:30:01.814ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "97360311-7bc0-4295-942c-f1d4d30de121", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89442025-04-30T06:30:01.816ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
89452025-04-30T06:30:01.820ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c315768-50f2-492a-bf39-b0e1e42951aa", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89462025-04-30T06:30:01.821ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
89472025-04-30T06:30:01.828ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7f48c39-8845-4775-92a7-00874eb27935", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89482025-04-30T06:30:01.828ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
89492025-04-30T06:30:01.833ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "86d95e09-bf04-48e5-a5f2-099ca3d0d73e", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89502025-04-30T06:30:01.833ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
89512025-04-30T06:30:01.837ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "80ff535d-35e1-4984-a252-b6f8613da34c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89522025-04-30T06:30:01.838ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
89532025-04-30T06:30:01.845ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8060c11-5948-40bb-8a14-5e20fecdaa26", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89542025-04-30T06:30:01.845ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
89552025-04-30T06:30:01.845ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
89562025-04-30T06:30:01.849ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e73e751-1f65-479d-854b-36636dad8de2", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89572025-04-30T06:30:01.849ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
89582025-04-30T06:30:01.851ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c15f6db-4d30-4653-a439-453d32073145", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89592025-04-30T06:30:01.852ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
89602025-04-30T06:30:01.854ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb9f4581-8df4-4393-9203-7d10ced7fd8d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89612025-04-30T06:30:01.854ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
89622025-04-30T06:30:01.855ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "735aec03-9430-4938-b43a-e3977540f6c8", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89632025-04-30T06:30:01.856ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
89642025-04-30T06:30:01.857ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a8da9e5-36e3-4f35-b059-81150b9e4c34", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89652025-04-30T06:30:01.858ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
89662025-04-30T06:30:01.860ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "953bfa67-e6db-4e4a-8fa4-70a66a704907", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89672025-04-30T06:30:01.860ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
89682025-04-30T06:30:01.865ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4add0d34-25cb-48e6-bb83-2993fcd5aa0c", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89692025-04-30T06:30:01.865ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
89702025-04-30T06:30:01.868ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0d56afa-4aab-43c0-ad00-418ecb168d37", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89712025-04-30T06:30:01.868ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
89722025-04-30T06:30:01.871ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "13046442-e32c-42e5-b4d3-acaa9a9a7a85", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89732025-04-30T06:30:01.872ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
89742025-04-30T06:30:01.874ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "046663ce-f6a9-4b45-90bf-b0c25babcb76", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89752025-04-30T06:30:01.874ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
89762025-04-30T06:30:01.877ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0ae9e54-034b-4280-89b9-78233c911fa8", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89772025-04-30T06:30:01.878ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
89782025-04-30T06:30:01.880ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f7fbc85-627f-4bb6-b97c-174262a58b03", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89792025-04-30T06:30:01.880ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
89802025-04-30T06:30:01.882ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "452f9286-b624-41c5-b653-3071e21f3322", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89812025-04-30T06:30:01.882ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
89822025-04-30T06:30:01.883ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec8f4006-2a6f-4203-b8ec-55f9db7445cd", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89832025-04-30T06:30:01.884ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
89842025-04-30T06:30:01.884ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4087ba71-1422-4d05-8941-2017bb2bc1d3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89852025-04-30T06:30:01.885ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
89862025-04-30T06:30:01.886ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "179687ba-225c-4d85-9bf9-58b16bd16695", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89872025-04-30T06:30:01.886ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
89882025-04-30T06:30:01.887ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "58f8fab1-dde5-45e3-a6ec-e6a0d0fa03ab", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89892025-04-30T06:30:01.887ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
89902025-04-30T06:30:01.888ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b0f4aa2-3728-4bfb-98d7-870effa19c9e", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89912025-04-30T06:30:01.888ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
89922025-04-30T06:30:01.891ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4baf4370-61ab-4602-bbab-24c2e6113f38", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89932025-04-30T06:30:01.891ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
89942025-04-30T06:30:01.893ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f03b7476-6a4c-464b-82fc-7ec982ecc3ea", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
89952025-04-30T06:30:01.893ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
89962025-04-30T06:30:01.900ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
89972025-04-30T06:30:01.900ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89982025-04-30T06:30:01.900ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
89992025-04-30T06:30:01.900ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
90002025-04-30T06:30:01.901ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
90012025-04-30T06:30:01.906ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1653583e-02d5-4b87-a1f6-4e29d38cb963", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90022025-04-30T06:30:01.906ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
90032025-04-30T06:30:01.907ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90042025-04-30T06:30:01.913ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
90052025-04-30T06:30:01.913ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
90062025-04-30T06:30:01.913ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
90072025-04-30T06:30:01.914ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
90082025-04-30T06:30:01.916ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9027826-bdef-463a-9642-0b9bd42d1d78", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90092025-04-30T06:30:01.916ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
90102025-04-30T06:30:01.917ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
90112025-04-30T06:30:01.917ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
90122025-04-30T06:30:01.917ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
90132025-04-30T06:30:01.920ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d3fff82-c3a9-44d6-b59d-ad45c4229c34", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90142025-04-30T06:30:01.921ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
90152025-04-30T06:30:01.924ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fa75b48-cd72-4bf0-b900-dd1172c30d33", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90162025-04-30T06:30:01.924ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
90172025-04-30T06:30:01.926ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e903e030-33eb-41f5-bc3d-bdbc9679698c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90182025-04-30T06:30:01.926ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
90192025-04-30T06:30:01.929ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7da8810d-83b1-4235-a3af-218575c121ea", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90202025-04-30T06:30:01.929ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
90212025-04-30T06:30:01.931ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d5a24b1-6d56-466c-b7c0-85048af351e0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90222025-04-30T06:30:01.931ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
90232025-04-30T06:30:01.932ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcd1c42f-bb99-4526-8fc8-2fb8355c67e3", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90242025-04-30T06:30:01.933ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
90252025-04-30T06:30:01.938ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "84341b83-03b1-4ce5-9c0c-9801271e71ec", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90262025-04-30T06:30:01.938ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
90272025-04-30T06:30:01.944ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fb019da-bea3-44ab-9171-a25634cea9d1", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90282025-04-30T06:30:01.944ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
90292025-04-30T06:30:01.949ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
90302025-04-30T06:30:01.952ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "767baf85-8c45-460f-bfaa-4b34ac5da1a0", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90312025-04-30T06:30:01.952ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
90322025-04-30T06:30:01.954ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cafd949-b7af-4867-a963-d2b2d05852c1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90332025-04-30T06:30:01.955ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
90342025-04-30T06:30:01.957ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcc0fd0b-16c3-4ab3-8d6f-161c1921cbee", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90352025-04-30T06:30:01.957ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
90362025-04-30T06:30:01.959ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "796746a3-df73-4426-9116-2217400b955c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90372025-04-30T06:30:01.960ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
90382025-04-30T06:30:01.962ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "42bb6347-46be-4648-b7f4-dcf4f183da72", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90392025-04-30T06:30:01.963ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
90402025-04-30T06:30:01.964ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bef56285-0fa2-43d0-a2f8-95f10b53d828", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90412025-04-30T06:30:01.965ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
90422025-04-30T06:30:01.966ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7560bc06-c6f3-47fd-a82c-b4d7246f60a4", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90432025-04-30T06:30:01.967ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
90442025-04-30T06:30:01.968ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49bf5892-6830-4415-af51-c6e96e5811e1", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90452025-04-30T06:30:01.968ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
90462025-04-30T06:30:01.969ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a91bc32-7bc4-4c21-9b58-809ff4ef36b5", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90472025-04-30T06:30:01.970ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
90482025-04-30T06:30:01.970ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90492025-04-30T06:30:01.970ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
90502025-04-30T06:30:01.970ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90512025-04-30T06:30:01.971ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90522025-04-30T06:30:01.975ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90532025-04-30T06:30:01.982ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
90542025-04-30T06:30:01.983ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
90552025-04-30T06:30:01.983ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90562025-04-30T06:30:01.983ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
90572025-04-30T06:30:01.983ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90582025-04-30T06:30:01.983ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90592025-04-30T06:30:01.986ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90602025-04-30T06:30:01.992ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
90612025-04-30T06:30:01.992ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
90622025-04-30T06:30:01.992ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90632025-04-30T06:30:01.994ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90642025-04-30T06:30:02.071ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
90652025-04-30T06:30:02.074ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
90662025-04-30T06:30:02.074ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
90672025-04-30T06:30:02.074ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90682025-04-30T06:30:02.074ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
90692025-04-30T06:30:02.074ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
90702025-04-30T06:30:02.075ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
90712025-04-30T06:30:02.075ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:65020 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
90722025-04-30T06:30:02.076ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:65020 req_id = ee61e2cc-263a-41b1-b7c9-fa4f2d0a9586 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
90732025-04-30T06:30:02.077ZINFOtest_image_create (dropshot): request completed latency_us = 586 local_addr = [::1]:42828 method = GET remote_addr = [::1]:65020 req_id = ee61e2cc-263a-41b1-b7c9-fa4f2d0a9586 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
90742025-04-30T06:30:02.077ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee61e2cc-263a-41b1-b7c9-fa4f2d0a9586", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
90752025-04-30T06:30:02.079ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
90762025-04-30T06:30:02.079ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
90772025-04-30T06:30:02.079ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
90782025-04-30T06:30:02.084ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
90792025-04-30T06:30:02.084ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90802025-04-30T06:30:02.084ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
90812025-04-30T06:30:02.084ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90822025-04-30T06:30:02.085ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90832025-04-30T06:30:02.085ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90842025-04-30T06:30:02.093ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
90852025-04-30T06:30:02.093ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
90862025-04-30T06:30:02.093ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
90872025-04-30T06:30:02.094ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
90882025-04-30T06:30:02.097ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90892025-04-30T06:30:02.100ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
90902025-04-30T06:30:02.101ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
90912025-04-30T06:30:02.101ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90922025-04-30T06:30:02.101ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90932025-04-30T06:30:02.103ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
90942025-04-30T06:30:02.103ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
90952025-04-30T06:30:02.105ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
90962025-04-30T06:30:02.139ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
90972025-04-30T06:30:02.140ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
90982025-04-30T06:30:02.140ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 485.850906ms iteration = 30 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
90992025-04-30T06:30:02.140ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 31 reason = Signaled
91002025-04-30T06:30:02.141ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
91012025-04-30T06:30:02.141ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
91022025-04-30T06:30:02.141ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
91032025-04-30T06:30:02.141ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
91042025-04-30T06:30:02.144ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
91052025-04-30T06:30:02.148ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91062025-04-30T06:30:02.153ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
91072025-04-30T06:30:02.153ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
91082025-04-30T06:30:02.153ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
91092025-04-30T06:30:02.154ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
91102025-04-30T06:30:02.158ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
91112025-04-30T06:30:02.162ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
91122025-04-30T06:30:02.162ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
91132025-04-30T06:30:02.167ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: f9 75 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .u..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:52467 req_id = 2db6815e-2c48-42c2-9904-501b4078786b
91142025-04-30T06:30:02.167ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63861,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52467 req_id = 2db6815e-2c48-42c2-9904-501b4078786b
91152025-04-30T06:30:02.167ZDEBGtest_image_create (store): query key key = _mgs._tcp
91162025-04-30T06:30:02.167ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
91172025-04-30T06:30:02.168ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:52467 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 2db6815e-2c48-42c2-9904-501b4078786b
91182025-04-30T06:30:02.169ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3466, tv_nsec: 968501268 } })
91192025-04-30T06:30:02.169ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
91202025-04-30T06:30:02.169ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: e0 0f 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:63608 req_id = e5753809-4a23-4e55-b4d9-d57a96fb968e
91212025-04-30T06:30:02.170ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 57359,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63608 req_id = e5753809-4a23-4e55-b4d9-d57a96fb968e
91222025-04-30T06:30:02.170ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
91232025-04-30T06:30:02.170ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:63608 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = e5753809-4a23-4e55-b4d9-d57a96fb968e
91242025-04-30T06:30:02.232ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
91252025-04-30T06:30:02.234ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
91262025-04-30T06:30:02.234ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
91272025-04-30T06:30:02.234ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
91282025-04-30T06:30:02.234ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
91292025-04-30T06:30:02.234ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
91302025-04-30T06:30:02.235ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 34 14 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c 4............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:51935 req_id = 1f75edbe-facf-4812-abdd-28d2e7617b59
91312025-04-30T06:30:02.235ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 13332,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51935 req_id = 1f75edbe-facf-4812-abdd-28d2e7617b59
91322025-04-30T06:30:02.235ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
91332025-04-30T06:30:02.235ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13332, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:51935 req_id = 1f75edbe-facf-4812-abdd-28d2e7617b59
91342025-04-30T06:30:02.236ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
91352025-04-30T06:30:02.236ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
91362025-04-30T06:30:02.236ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
91372025-04-30T06:30:02.238ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91382025-04-30T06:30:02.246ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
91392025-04-30T06:30:02.246ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
91402025-04-30T06:30:02.246ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
91412025-04-30T06:30:02.247ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
91422025-04-30T06:30:02.248ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aa3ef32-5fae-46bb-901e-f685f6752068", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91432025-04-30T06:30:02.248ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
91442025-04-30T06:30:02.250ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
91452025-04-30T06:30:02.250ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
91462025-04-30T06:30:02.250ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
91472025-04-30T06:30:02.250ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3ed85ed-5daf-4e78-8469-3ba9ef11c398", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91482025-04-30T06:30:02.251ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
91492025-04-30T06:30:02.257ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6dec3af-d285-4319-afd9-5b29005139b1", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91502025-04-30T06:30:02.257ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
91512025-04-30T06:30:02.260ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a89e703-0034-401b-9857-c4e0437224dc", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91522025-04-30T06:30:02.260ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
91532025-04-30T06:30:02.264ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "be7bba05-7af0-4f4b-9c89-302acf6b30e5", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91542025-04-30T06:30:02.264ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
91552025-04-30T06:30:02.270ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6b44c2-1ba4-4d02-a169-1a2453147aa8", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91562025-04-30T06:30:02.270ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
91572025-04-30T06:30:02.275ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ac70088-6d3e-4f41-8fbe-8c6105fe38ee", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91582025-04-30T06:30:02.275ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
91592025-04-30T06:30:02.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1435aa95-f780-42d9-9cfc-952c1060b8ae", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91602025-04-30T06:30:02.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
91612025-04-30T06:30:02.281ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc16454c-9224-4a5e-98c9-c9f3447450fd", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91622025-04-30T06:30:02.281ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
91632025-04-30T06:30:02.284ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24e61285-89af-44b1-a465-a7dce04e673a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91642025-04-30T06:30:02.286ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
91652025-04-30T06:30:02.286ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
91662025-04-30T06:30:02.287ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5483ad86-ce68-4c82-87dc-292be744a277", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91672025-04-30T06:30:02.287ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
91682025-04-30T06:30:02.289ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfe61a2b-9517-400c-94e3-9d4b0d8aafd1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91692025-04-30T06:30:02.289ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
91702025-04-30T06:30:02.290ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbcb902a-be5d-40bb-9263-b534eb4d65e1", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91712025-04-30T06:30:02.290ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
91722025-04-30T06:30:02.292ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfadad4b-0725-4305-920c-00c9669bd3e8", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91732025-04-30T06:30:02.292ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
91742025-04-30T06:30:02.296ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0021cccc-0f45-43e1-a8f2-89221847587d", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91752025-04-30T06:30:02.296ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
91762025-04-30T06:30:02.302ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2ed655b-1ac7-4630-8af9-3ae969a937d9", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91772025-04-30T06:30:02.303ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
91782025-04-30T06:30:02.307ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "59a7af7c-2f2c-4d85-984c-b63b56d06ed8", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91792025-04-30T06:30:02.307ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
91802025-04-30T06:30:02.310ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c0416eb-b5e0-498a-926e-efd5243e68ee", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91812025-04-30T06:30:02.310ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
91822025-04-30T06:30:02.316ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4490fc58-63a1-4ab5-8faa-3cb01aaf2315", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91832025-04-30T06:30:02.317ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
91842025-04-30T06:30:02.318ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7ef0d44-8bfa-4c0f-8d64-fea84c436327", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91852025-04-30T06:30:02.319ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
91862025-04-30T06:30:02.321ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b6a5fe6-534a-4ed9-a349-7f1b999d9bcf", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91872025-04-30T06:30:02.321ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
91882025-04-30T06:30:02.323ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd6eb390-6441-492d-8c42-4ae6de5f4c20", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91892025-04-30T06:30:02.323ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
91902025-04-30T06:30:02.324ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "10d97dd1-79e5-43d8-866f-99ed77726989", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91912025-04-30T06:30:02.324ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
91922025-04-30T06:30:02.325ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1af6ff9c-9cc8-4ab9-a467-ddd428c6cdb6", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91932025-04-30T06:30:02.326ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
91942025-04-30T06:30:02.328ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce48dda6-89ab-4696-9d30-230e8a4e6f61", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91952025-04-30T06:30:02.328ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
91962025-04-30T06:30:02.330ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc02a49d-0414-4d39-a9cf-3d8c80219597", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91972025-04-30T06:30:02.330ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
91982025-04-30T06:30:02.336ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b063db09-92ca-40dd-9ccb-295b4f5460b8", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
91992025-04-30T06:30:02.336ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
92002025-04-30T06:30:02.337ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
92012025-04-30T06:30:02.337ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92022025-04-30T06:30:02.337ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
92032025-04-30T06:30:02.337ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
92042025-04-30T06:30:02.338ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
92052025-04-30T06:30:02.341ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92062025-04-30T06:30:02.347ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
92072025-04-30T06:30:02.348ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
92082025-04-30T06:30:02.348ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
92092025-04-30T06:30:02.348ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
92102025-04-30T06:30:02.350ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c456c8b-72b3-4d56-980f-1e6dd38adb2f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
92112025-04-30T06:30:02.350ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
92122025-04-30T06:30:02.351ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
92132025-04-30T06:30:02.351ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
92142025-04-30T06:30:02.351ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
92152025-04-30T06:30:02.355ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a82a97d9-4132-4154-b82a-b26f872be1bc", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:01 GMT"} })
92162025-04-30T06:30:02.356ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
92172025-04-30T06:30:02.361ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5727183a-443c-4037-ba84-57b8d5e0d09f", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92182025-04-30T06:30:02.361ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
92192025-04-30T06:30:02.363ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "11781731-8fe9-46f3-a5e2-cd8c1919f1f4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92202025-04-30T06:30:02.363ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
92212025-04-30T06:30:02.365ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5283206-29cc-492e-b317-cf407b4276ba", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92222025-04-30T06:30:02.366ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
92232025-04-30T06:30:02.368ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c435316a-8a86-471e-9c2d-f99d0202658e", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92242025-04-30T06:30:02.368ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
92252025-04-30T06:30:02.370ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "32c26263-b40e-4edb-b68a-41b9413105e8", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92262025-04-30T06:30:02.370ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
92272025-04-30T06:30:02.373ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0789fcde-f7c6-4436-8a5c-ec7a59772dc2", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92282025-04-30T06:30:02.373ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
92292025-04-30T06:30:02.376ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5948640-0ae1-47f2-a237-417e08565f08", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92302025-04-30T06:30:02.376ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
92312025-04-30T06:30:02.379ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8486a703-d4bc-410c-b86c-b4c40eb3fa2b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92322025-04-30T06:30:02.380ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
92332025-04-30T06:30:02.383ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
92342025-04-30T06:30:02.384ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2d9bdf5-4fab-4d6e-85ac-3f8d71bab55a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92352025-04-30T06:30:02.384ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
92362025-04-30T06:30:02.388ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "964331df-0cdf-455d-9691-c3f9fc5b8920", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92372025-04-30T06:30:02.388ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
92382025-04-30T06:30:02.389ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "22e50eb5-734e-48f1-97d1-33064a04f2c8", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92392025-04-30T06:30:02.389ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
92402025-04-30T06:30:02.391ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f6dad4c-d899-46fd-803a-6a191ddf857c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92412025-04-30T06:30:02.391ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
92422025-04-30T06:30:02.392ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d75a9f1e-b5ea-4b98-9b9c-ccdce185036a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92432025-04-30T06:30:02.392ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
92442025-04-30T06:30:02.393ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "79ab6eb8-24cc-4c1c-875b-2de84a4fd389", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92452025-04-30T06:30:02.394ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
92462025-04-30T06:30:02.395ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb25fdfd-6cb7-49bd-8060-df4204abe559", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92472025-04-30T06:30:02.395ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
92482025-04-30T06:30:02.396ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "039891e2-daa3-4774-9982-0334358c6b6c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92492025-04-30T06:30:02.396ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
92502025-04-30T06:30:02.396ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92512025-04-30T06:30:02.396ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
92522025-04-30T06:30:02.397ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
92532025-04-30T06:30:02.398ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
92542025-04-30T06:30:02.402ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92552025-04-30T06:30:02.407ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
92562025-04-30T06:30:02.408ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
92572025-04-30T06:30:02.408ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92582025-04-30T06:30:02.408ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
92592025-04-30T06:30:02.408ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
92602025-04-30T06:30:02.408ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
92612025-04-30T06:30:02.410ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92622025-04-30T06:30:02.417ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
92632025-04-30T06:30:02.417ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
92642025-04-30T06:30:02.417ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
92652025-04-30T06:30:02.418ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
92662025-04-30T06:30:02.419ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
92672025-04-30T06:30:02.419ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
92682025-04-30T06:30:02.420ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
92692025-04-30T06:30:02.421ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
92702025-04-30T06:30:02.421ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
92712025-04-30T06:30:02.421ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
92722025-04-30T06:30:02.504ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
92732025-04-30T06:30:02.504ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
92742025-04-30T06:30:02.504ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
92752025-04-30T06:30:02.504ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92762025-04-30T06:30:02.504ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
92772025-04-30T06:30:02.504ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
92782025-04-30T06:30:02.505ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
92792025-04-30T06:30:02.506ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:40697 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
92802025-04-30T06:30:02.507ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:40697 req_id = 8d35b6ca-d5ae-44e8-9e05-164b32ff57c3 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
92812025-04-30T06:30:02.508ZINFOtest_image_create (dropshot): request completed latency_us = 1021 local_addr = [::1]:42828 method = GET remote_addr = [::1]:40697 req_id = 8d35b6ca-d5ae-44e8-9e05-164b32ff57c3 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
92822025-04-30T06:30:02.509ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d35b6ca-d5ae-44e8-9e05-164b32ff57c3", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
92832025-04-30T06:30:02.516ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
92842025-04-30T06:30:02.516ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
92852025-04-30T06:30:02.516ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
92862025-04-30T06:30:02.528ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
92872025-04-30T06:30:02.528ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92882025-04-30T06:30:02.528ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
92892025-04-30T06:30:02.528ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
92902025-04-30T06:30:02.529ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
92912025-04-30T06:30:02.530ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92922025-04-30T06:30:02.540ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
92932025-04-30T06:30:02.540ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
92942025-04-30T06:30:02.540ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
92952025-04-30T06:30:02.542ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
92962025-04-30T06:30:02.544ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
92972025-04-30T06:30:02.544ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
92982025-04-30T06:30:02.547ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
92992025-04-30T06:30:02.547ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
93002025-04-30T06:30:02.548ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93012025-04-30T06:30:02.574ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
93022025-04-30T06:30:02.581ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
93032025-04-30T06:30:02.581ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
93042025-04-30T06:30:02.581ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
93052025-04-30T06:30:02.593ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
93062025-04-30T06:30:02.593ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
93072025-04-30T06:30:02.594ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
93082025-04-30T06:30:02.595ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
93092025-04-30T06:30:02.595ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
93102025-04-30T06:30:02.604ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
93112025-04-30T06:30:02.604ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
93122025-04-30T06:30:02.648ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
93132025-04-30T06:30:02.655ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
93142025-04-30T06:30:02.655ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
93152025-04-30T06:30:02.655ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 514.773303ms iteration = 31 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
93162025-04-30T06:30:02.655ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 32 reason = Signaled
93172025-04-30T06:30:02.655ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
93182025-04-30T06:30:02.655ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
93192025-04-30T06:30:02.657ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
93202025-04-30T06:30:02.657ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
93212025-04-30T06:30:02.658ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
93222025-04-30T06:30:02.661ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93232025-04-30T06:30:02.667ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
93242025-04-30T06:30:02.667ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
93252025-04-30T06:30:02.667ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
93262025-04-30T06:30:02.668ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
93272025-04-30T06:30:02.671ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
93282025-04-30T06:30:02.671ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
93292025-04-30T06:30:02.672ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 3c a3 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 <............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:55941 req_id = 900f026d-fdd2-4cc5-aff5-e19692358221
93302025-04-30T06:30:02.672ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 15523,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55941 req_id = 900f026d-fdd2-4cc5-aff5-e19692358221
93312025-04-30T06:30:02.672ZDEBGtest_image_create (store): query key key = _mgs._tcp
93322025-04-30T06:30:02.672ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
93332025-04-30T06:30:02.672ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:55941 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 900f026d-fdd2-4cc5-aff5-e19692358221
93342025-04-30T06:30:02.673ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3467, tv_nsec: 472044716 } })
93352025-04-30T06:30:02.673ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
93362025-04-30T06:30:02.675ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: b6 da 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:64487 req_id = d86c6200-f6a1-4551-a0b2-3b791186acbb
93372025-04-30T06:30:02.675ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 46810,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64487 req_id = d86c6200-f6a1-4551-a0b2-3b791186acbb
93382025-04-30T06:30:02.675ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
93392025-04-30T06:30:02.675ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:64487 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = d86c6200-f6a1-4551-a0b2-3b791186acbb
93402025-04-30T06:30:02.740ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
93412025-04-30T06:30:02.741ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
93422025-04-30T06:30:02.742ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: e6 52 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .R..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:59482 req_id = 6ec23587-4333-4a3f-8c3d-2b95626b541c
93432025-04-30T06:30:02.742ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 58962,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59482 req_id = 6ec23587-4333-4a3f-8c3d-2b95626b541c
93442025-04-30T06:30:02.742ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
93452025-04-30T06:30:02.743ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58962, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59482 req_id = 6ec23587-4333-4a3f-8c3d-2b95626b541c
93462025-04-30T06:30:02.743ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
93472025-04-30T06:30:02.743ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
93482025-04-30T06:30:02.743ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
93492025-04-30T06:30:02.745ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d39e47e-f81c-4e39-a47f-5a8e09704c39", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93502025-04-30T06:30:02.745ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
93512025-04-30T06:30:02.747ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "885957d4-bfd2-41cf-af6a-005708b34a70", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93522025-04-30T06:30:02.748ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
93532025-04-30T06:30:02.763ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5f8cf13-5a09-4cf7-abe5-a3484d331e48", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93542025-04-30T06:30:02.763ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
93552025-04-30T06:30:02.765ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc08be93-c815-46c7-a49f-db09b2b0f0f0", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93562025-04-30T06:30:02.765ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
93572025-04-30T06:30:02.767ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d624247-234b-4bf2-b33a-ac50b66fd595", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93582025-04-30T06:30:02.767ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
93592025-04-30T06:30:02.770ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1244fb14-32c3-4dfc-8871-4e539c156e58", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93602025-04-30T06:30:02.770ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
93612025-04-30T06:30:02.772ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4fa34a6-635f-4f75-b99b-262a4c3b666f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93622025-04-30T06:30:02.772ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
93632025-04-30T06:30:02.774ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b01afa02-3ec6-407a-b479-58ce54e31097", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93642025-04-30T06:30:02.774ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
93652025-04-30T06:30:02.775ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "51bc23a7-23fb-4609-acb4-49a26319042a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93662025-04-30T06:30:02.775ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
93672025-04-30T06:30:02.776ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f88021fb-77bb-4c5d-badd-db8954e48fb5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93682025-04-30T06:30:02.776ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
93692025-04-30T06:30:02.777ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "98cb87b9-1abb-4390-a3c1-a603066c0a44", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93702025-04-30T06:30:02.777ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
93712025-04-30T06:30:02.779ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b122e36-9078-4334-a22c-e931005c431c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93722025-04-30T06:30:02.779ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
93732025-04-30T06:30:02.780ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdad58d7-e788-4d59-b2c7-50d6cde33415", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93742025-04-30T06:30:02.780ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
93752025-04-30T06:30:02.787ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "caaa83f1-a26b-4976-9891-3094232b72fb", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93762025-04-30T06:30:02.789ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
93772025-04-30T06:30:02.792ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
93782025-04-30T06:30:02.792ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
93792025-04-30T06:30:02.792ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
93802025-04-30T06:30:02.792ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
93812025-04-30T06:30:02.793ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
93822025-04-30T06:30:02.795ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "226933bb-ab19-48d4-8e6d-34c0d0d00cec", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93832025-04-30T06:30:02.795ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
93842025-04-30T06:30:02.796ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93852025-04-30T06:30:02.802ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
93862025-04-30T06:30:02.803ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
93872025-04-30T06:30:02.803ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
93882025-04-30T06:30:02.803ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
93892025-04-30T06:30:02.807ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
93902025-04-30T06:30:02.808ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
93912025-04-30T06:30:02.809ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
93922025-04-30T06:30:02.811ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "782153a3-833d-459a-8e89-4b5cb497cc9b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93932025-04-30T06:30:02.811ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
93942025-04-30T06:30:02.819ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d063fd0-0948-4d80-8e49-97474a938a3e", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93952025-04-30T06:30:02.819ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
93962025-04-30T06:30:02.826ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "823b37a4-a001-4b42-9d8e-28d36bd36b70", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93972025-04-30T06:30:02.826ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
93982025-04-30T06:30:02.832ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "143e0977-c216-4050-beea-4f7af3bebeab", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
93992025-04-30T06:30:02.832ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
94002025-04-30T06:30:02.835ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f326aa7-6120-4973-86ba-68f6206c85fd", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94012025-04-30T06:30:02.835ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
94022025-04-30T06:30:02.838ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "777f703d-b5ed-4e77-a5a7-6af164a4f574", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94032025-04-30T06:30:02.839ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
94042025-04-30T06:30:02.844ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "86f0a25b-cae6-4505-b604-60dd18408e02", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94052025-04-30T06:30:02.844ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
94062025-04-30T06:30:02.845ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
94072025-04-30T06:30:02.847ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "74f25e10-317c-4142-83da-b8716c105dae", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94082025-04-30T06:30:02.847ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
94092025-04-30T06:30:02.849ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "efed7d15-77d4-48e6-96cd-ea13f1bc6a27", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94102025-04-30T06:30:02.849ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
94112025-04-30T06:30:02.852ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "104b5adc-bb88-4ec2-839d-4a9dab98bfbf", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94122025-04-30T06:30:02.852ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
94132025-04-30T06:30:02.858ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8edba829-a94a-488f-91fa-b9194b001a01", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94142025-04-30T06:30:02.858ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
94152025-04-30T06:30:02.863ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "544ba2dd-7eca-4f2c-a779-8f88503e7460", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94162025-04-30T06:30:02.863ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
94172025-04-30T06:30:02.868ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d60b7171-4536-4e4a-a76f-d65443cdc9f4", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94182025-04-30T06:30:02.868ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
94192025-04-30T06:30:02.871ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "78451a08-7ea4-455b-944a-6d564ac25891", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94202025-04-30T06:30:02.872ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
94212025-04-30T06:30:02.875ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7b717c-ec13-4f80-878b-9f2d97833deb", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94222025-04-30T06:30:02.875ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
94232025-04-30T06:30:02.877ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0869c33f-96fe-4e8d-b9fb-a4220dbf07aa", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94242025-04-30T06:30:02.878ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
94252025-04-30T06:30:02.879ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49427be2-1b7d-4ce4-bd40-fc3ed8af5453", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94262025-04-30T06:30:02.879ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
94272025-04-30T06:30:02.880ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "53e49d09-1ab6-4c6a-9fe5-aea35b267e77", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94282025-04-30T06:30:02.880ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
94292025-04-30T06:30:02.881ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "99baaba7-91e5-4754-b67d-042c264826fb", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94302025-04-30T06:30:02.881ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
94312025-04-30T06:30:02.882ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5fd9842-2b19-4bfb-bc8c-d144a73c30a9", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94322025-04-30T06:30:02.882ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
94332025-04-30T06:30:02.884ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bc9dd45-f34c-4f19-bbec-6d0945490cbc", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94342025-04-30T06:30:02.885ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
94352025-04-30T06:30:02.887ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e4ffc0e-e063-4744-a4bc-014b711e89b3", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94362025-04-30T06:30:02.887ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
94372025-04-30T06:30:02.890ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "903b6879-e679-4300-9498-1cd1731fd255", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94382025-04-30T06:30:02.890ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
94392025-04-30T06:30:02.893ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4744bd82-2955-4e40-bbc2-6bbbbea3087b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94402025-04-30T06:30:02.893ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
94412025-04-30T06:30:02.896ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "95169e8d-8f0d-4a92-9fbf-7844e5f9229a", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94422025-04-30T06:30:02.896ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
94432025-04-30T06:30:02.898ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
94442025-04-30T06:30:02.899ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94452025-04-30T06:30:02.899ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
94462025-04-30T06:30:02.899ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
94472025-04-30T06:30:02.900ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
94482025-04-30T06:30:02.907ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94492025-04-30T06:30:02.921ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
94502025-04-30T06:30:02.921ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
94512025-04-30T06:30:02.921ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
94522025-04-30T06:30:02.922ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
94532025-04-30T06:30:02.929ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
94542025-04-30T06:30:02.930ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
94552025-04-30T06:30:02.930ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
94562025-04-30T06:30:02.932ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a4bd144-6f13-455f-bfdd-147e88a87133", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94572025-04-30T06:30:02.933ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
94582025-04-30T06:30:02.934ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d0cfdc2-fbce-48b8-ada1-6a9d95e0c82c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94592025-04-30T06:30:02.934ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
94602025-04-30T06:30:02.937ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6224c8af-c79c-47a2-ade5-b496c3ab47a5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94612025-04-30T06:30:02.937ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
94622025-04-30T06:30:02.947ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3187fa45-851a-46e3-b486-4856aa8389b3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94632025-04-30T06:30:02.947ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
94642025-04-30T06:30:02.950ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b056adf9-36e7-4a5f-b989-86442595cb49", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94652025-04-30T06:30:02.951ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
94662025-04-30T06:30:02.951ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94672025-04-30T06:30:02.951ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
94682025-04-30T06:30:02.951ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94692025-04-30T06:30:02.953ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94702025-04-30T06:30:02.955ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94712025-04-30T06:30:02.964ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
94722025-04-30T06:30:02.964ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
94732025-04-30T06:30:02.964ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94742025-04-30T06:30:02.964ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
94752025-04-30T06:30:02.964ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94762025-04-30T06:30:02.965ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94772025-04-30T06:30:02.969ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94782025-04-30T06:30:02.979ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
94792025-04-30T06:30:02.979ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
94802025-04-30T06:30:02.979ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94812025-04-30T06:30:02.981ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94822025-04-30T06:30:03.049ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
94832025-04-30T06:30:03.049ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
94842025-04-30T06:30:03.050ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:41287 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
94852025-04-30T06:30:03.050ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:41287 req_id = ad44651a-a74b-4cde-a813-bd42b055deac sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
94862025-04-30T06:30:03.051ZINFOtest_image_create (dropshot): request completed latency_us = 546 local_addr = [::1]:42828 method = GET remote_addr = [::1]:41287 req_id = ad44651a-a74b-4cde-a813-bd42b055deac response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
94872025-04-30T06:30:03.051ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad44651a-a74b-4cde-a813-bd42b055deac", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
94882025-04-30T06:30:03.054ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
94892025-04-30T06:30:03.054ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
94902025-04-30T06:30:03.054ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
94912025-04-30T06:30:03.057ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
94922025-04-30T06:30:03.058ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94932025-04-30T06:30:03.058ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
94942025-04-30T06:30:03.058ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94952025-04-30T06:30:03.061ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94962025-04-30T06:30:03.065ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94972025-04-30T06:30:03.071ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
94982025-04-30T06:30:03.071ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
94992025-04-30T06:30:03.071ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
95002025-04-30T06:30:03.073ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
95012025-04-30T06:30:03.073ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
95022025-04-30T06:30:03.109ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
95032025-04-30T06:30:03.109ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
95042025-04-30T06:30:03.109ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 454.024213ms iteration = 32 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
95052025-04-30T06:30:03.109ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 33 reason = Signaled
95062025-04-30T06:30:03.109ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
95072025-04-30T06:30:03.109ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95082025-04-30T06:30:03.109ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
95092025-04-30T06:30:03.109ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
95102025-04-30T06:30:03.110ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
95112025-04-30T06:30:03.116ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95122025-04-30T06:30:03.127ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
95132025-04-30T06:30:03.128ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
95142025-04-30T06:30:03.128ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
95152025-04-30T06:30:03.129ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
95162025-04-30T06:30:03.129ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
95172025-04-30T06:30:03.130ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95182025-04-30T06:30:03.130ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
95192025-04-30T06:30:03.130ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
95202025-04-30T06:30:03.132ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
95212025-04-30T06:30:03.137ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
95222025-04-30T06:30:03.137ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
95232025-04-30T06:30:03.141ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 8c 39 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .9..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:63777 req_id = 988d6405-f45d-4ded-922b-e97debc3a2a3
95242025-04-30T06:30:03.142ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 35897,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63777 req_id = 988d6405-f45d-4ded-922b-e97debc3a2a3
95252025-04-30T06:30:03.144ZDEBGtest_image_create (store): query key key = _mgs._tcp
95262025-04-30T06:30:03.145ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
95272025-04-30T06:30:03.146ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63777 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 988d6405-f45d-4ded-922b-e97debc3a2a3
95282025-04-30T06:30:03.147ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3467, tv_nsec: 946526540 } })
95292025-04-30T06:30:03.148ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
95302025-04-30T06:30:03.157ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95312025-04-30T06:30:03.165ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
95322025-04-30T06:30:03.165ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
95332025-04-30T06:30:03.166ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
95342025-04-30T06:30:03.166ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
95352025-04-30T06:30:03.167ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: b2 5c 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .\\..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56495 req_id = 47514698-808d-4405-8b17-a3eaa41bcec5
95362025-04-30T06:30:03.167ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45660,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56495 req_id = 47514698-808d-4405-8b17-a3eaa41bcec5
95372025-04-30T06:30:03.167ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
95382025-04-30T06:30:03.167ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56495 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 47514698-808d-4405-8b17-a3eaa41bcec5
95392025-04-30T06:30:03.244ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
95402025-04-30T06:30:03.244ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
95412025-04-30T06:30:03.244ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
95422025-04-30T06:30:03.245ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
95432025-04-30T06:30:03.245ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: c9 cb 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:61765 req_id = ab3c32b8-4128-4949-ba61-4333de51f9b1
95442025-04-30T06:30:03.245ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 51659,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61765 req_id = ab3c32b8-4128-4949-ba61-4333de51f9b1
95452025-04-30T06:30:03.246ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
95462025-04-30T06:30:03.246ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51659, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:61765 req_id = ab3c32b8-4128-4949-ba61-4333de51f9b1
95472025-04-30T06:30:03.247ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
95482025-04-30T06:30:03.247ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
95492025-04-30T06:30:03.247ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
95502025-04-30T06:30:03.250ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a32c440-8e5e-48c4-8c2a-6ea447f58a59", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95512025-04-30T06:30:03.251ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
95522025-04-30T06:30:03.252ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "48de78a2-3488-4588-99e7-b251eb6f624b", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95532025-04-30T06:30:03.253ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
95542025-04-30T06:30:03.255ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "37aece8e-ea43-439b-889a-14a9071bf621", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95552025-04-30T06:30:03.255ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
95562025-04-30T06:30:03.258ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "40e277e2-40a1-4466-8660-714a507091c1", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95572025-04-30T06:30:03.258ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
95582025-04-30T06:30:03.261ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "80a46a9d-8cbe-40ad-8823-af821794fc02", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95592025-04-30T06:30:03.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
95602025-04-30T06:30:03.264ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "12141857-6faa-4b31-8d41-575af1231832", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95612025-04-30T06:30:03.264ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
95622025-04-30T06:30:03.266ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b930376-ed09-4ec3-aba6-ef7d2b435731", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95632025-04-30T06:30:03.266ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
95642025-04-30T06:30:03.268ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "804a46b1-2fc1-4d70-844c-153a639c0820", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95652025-04-30T06:30:03.268ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
95662025-04-30T06:30:03.269ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "830d823f-33fc-4ee6-a37f-a57a49e52925", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95672025-04-30T06:30:03.269ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
95682025-04-30T06:30:03.270ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "199ee99f-cb0c-44ca-8459-020c7424eb38", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95692025-04-30T06:30:03.272ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
95702025-04-30T06:30:03.276ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "543e1841-728b-4ae3-9ca5-abf399a32f36", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95712025-04-30T06:30:03.276ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
95722025-04-30T06:30:03.277ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
95732025-04-30T06:30:03.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8632d0dc-42dd-4385-a5e0-c2270bd29f78", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95742025-04-30T06:30:03.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
95752025-04-30T06:30:03.281ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8f997ea-93fe-4e33-b696-977f9f289093", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95762025-04-30T06:30:03.281ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
95772025-04-30T06:30:03.284ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "615bfb6f-0648-427a-b400-bb83e96b07b9", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95782025-04-30T06:30:03.284ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
95792025-04-30T06:30:03.286ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "80a2394b-7645-4d45-b045-766a761d47e8", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95802025-04-30T06:30:03.286ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
95812025-04-30T06:30:03.289ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ca143eb-e38e-4c9c-8f4b-27096a786f3f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95822025-04-30T06:30:03.290ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
95832025-04-30T06:30:03.292ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d15d0cb-7493-44ac-8482-30bd2207b429", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95842025-04-30T06:30:03.301ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
95852025-04-30T06:30:03.306ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
95862025-04-30T06:30:03.306ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
95872025-04-30T06:30:03.307ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c02deabd-314a-41d1-87f2-e955f8d47b19 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
95882025-04-30T06:30:03.307ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c02deabd-314a-41d1-87f2-e955f8d47b19 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
95892025-04-30T06:30:03.307ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c02deabd-314a-41d1-87f2-e955f8d47b19 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
95902025-04-30T06:30:03.308ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c02deabd-314a-41d1-87f2-e955f8d47b19 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
95912025-04-30T06:30:03.310ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d06b8b2-a18a-4cf0-a8fa-b63ef9e20182", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95922025-04-30T06:30:03.310ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
95932025-04-30T06:30:03.313ZINFOtest_image_create (dropshot_internal): request completed latency_us = 6597 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = c02deabd-314a-41d1-87f2-e955f8d47b19 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
95942025-04-30T06:30:03.314ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c02deabd-314a-41d1-87f2-e955f8d47b19", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
95952025-04-30T06:30:03.314ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
95962025-04-30T06:30:03.316ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 4c83d26d-7cca-4b25-8c04-d3f86c491ea3 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
95972025-04-30T06:30:03.316ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 4c83d26d-7cca-4b25-8c04-d3f86c491ea3 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
95982025-04-30T06:30:03.316ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 4c83d26d-7cca-4b25-8c04-d3f86c491ea3 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
95992025-04-30T06:30:03.317ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 4c83d26d-7cca-4b25-8c04-d3f86c491ea3 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
96002025-04-30T06:30:03.319ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3d58b41-d005-450c-a135-2088d8757ffa", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96012025-04-30T06:30:03.319ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
96022025-04-30T06:30:03.320ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3b34a5b-de8c-4839-a401-fc6be6bab87c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96032025-04-30T06:30:03.320ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
96042025-04-30T06:30:03.320ZINFOtest_image_create (dropshot_internal): request completed latency_us = 4863 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 4c83d26d-7cca-4b25-8c04-d3f86c491ea3 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
96052025-04-30T06:30:03.321ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c83d26d-7cca-4b25-8c04-d3f86c491ea3", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96062025-04-30T06:30:03.321ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
96072025-04-30T06:30:03.321ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
96082025-04-30T06:30:03.321ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
96092025-04-30T06:30:03.323ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "468998ee-2c63-464e-9646-0feb4aec14a0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96102025-04-30T06:30:03.323ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
96112025-04-30T06:30:03.324ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb6eb25d-e902-4c65-b3ed-2550bc2b4abc", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96122025-04-30T06:30:03.324ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
96132025-04-30T06:30:03.326ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8156b41-620b-4bb5-9500-6cc7f5303ccd", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96142025-04-30T06:30:03.326ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
96152025-04-30T06:30:03.328ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
96162025-04-30T06:30:03.328ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96172025-04-30T06:30:03.328ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
96182025-04-30T06:30:03.328ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
96192025-04-30T06:30:03.329ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
96202025-04-30T06:30:03.330ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "70db9d6b-74fc-449d-ac50-b00409e73885", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96212025-04-30T06:30:03.331ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
96222025-04-30T06:30:03.335ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b8c9db7-e43e-4815-92da-ec27e396f99f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96232025-04-30T06:30:03.335ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
96242025-04-30T06:30:03.336ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96252025-04-30T06:30:03.351ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
96262025-04-30T06:30:03.352ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
96272025-04-30T06:30:03.352ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
96282025-04-30T06:30:03.352ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
96292025-04-30T06:30:03.356ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
96302025-04-30T06:30:03.356ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
96312025-04-30T06:30:03.357ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
96322025-04-30T06:30:03.357ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce56b814-5730-4c0b-8a98-4a44909c0506", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:02 GMT"} })
96332025-04-30T06:30:03.358ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
96342025-04-30T06:30:03.362ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e92dc99-0ddd-416e-ac1f-f23df07ec0c8", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96352025-04-30T06:30:03.362ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
96362025-04-30T06:30:03.365ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "86582634-bb8c-4e5a-a7c3-c90c71c043c6", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96372025-04-30T06:30:03.365ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
96382025-04-30T06:30:03.376ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6c678d4-11d9-420b-8fdd-866f739f721c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96392025-04-30T06:30:03.377ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
96402025-04-30T06:30:03.381ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "94f0f720-aed9-4d29-9b09-91ead0d965cc", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96412025-04-30T06:30:03.385ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
96422025-04-30T06:30:03.389ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "37d73de3-f90b-4faf-86e1-38bfbc1a7bea", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96432025-04-30T06:30:03.389ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
96442025-04-30T06:30:03.392ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e3210a6-123c-40d2-bbc6-ab0dc1bf0fcb", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96452025-04-30T06:30:03.393ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
96462025-04-30T06:30:03.395ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bc95c8e-1eef-4567-881f-6d87a29e61d9", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96472025-04-30T06:30:03.395ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
96482025-04-30T06:30:03.398ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d77ad75-0630-4aa0-b42a-6f0c3dae45ea", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96492025-04-30T06:30:03.398ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
96502025-04-30T06:30:03.402ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c33ff3ac-2b52-4298-8d9c-0176a423c44e", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96512025-04-30T06:30:03.402ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
96522025-04-30T06:30:03.404ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
96532025-04-30T06:30:03.415ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc4d177d-1812-4992-a1be-e0e0b03c39d0", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96542025-04-30T06:30:03.415ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
96552025-04-30T06:30:03.417ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4becebf-504d-44d0-8a99-917500335e9f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96562025-04-30T06:30:03.417ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
96572025-04-30T06:30:03.419ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
96582025-04-30T06:30:03.419ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
96592025-04-30T06:30:03.421ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
96602025-04-30T06:30:03.422ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
96612025-04-30T06:30:03.422ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
96622025-04-30T06:30:03.422ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
96632025-04-30T06:30:03.424ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "11c0e4fa-b147-4988-84d8-848d97f465ba", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96642025-04-30T06:30:03.425ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
96652025-04-30T06:30:03.429ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "abdd9c55-d985-47ee-9ed6-faa82b23078e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96662025-04-30T06:30:03.429ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
96672025-04-30T06:30:03.431ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ca3e4b3-034c-4bbf-a38d-235aa74485c3", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96682025-04-30T06:30:03.431ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
96692025-04-30T06:30:03.433ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c91ad32d-3efd-4edc-b543-41aef1e455ec", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96702025-04-30T06:30:03.433ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
96712025-04-30T06:30:03.436ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "30c3eea4-08e1-4794-ac02-c853148274c9", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96722025-04-30T06:30:03.436ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
96732025-04-30T06:30:03.437ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4832534d-aaf4-4c1d-9ff2-216deae09a0f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96742025-04-30T06:30:03.438ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
96752025-04-30T06:30:03.438ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8960b995-0326-4fb8-97fb-615ce2021781", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96762025-04-30T06:30:03.438ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
96772025-04-30T06:30:03.440ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dc797fe-98b5-4717-abe0-65395e1dddd3", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
96782025-04-30T06:30:03.440ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
96792025-04-30T06:30:03.440ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96802025-04-30T06:30:03.440ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
96812025-04-30T06:30:03.440ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
96822025-04-30T06:30:03.442ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
96832025-04-30T06:30:03.448ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96842025-04-30T06:30:03.463ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
96852025-04-30T06:30:03.463ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
96862025-04-30T06:30:03.463ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96872025-04-30T06:30:03.463ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
96882025-04-30T06:30:03.463ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
96892025-04-30T06:30:03.464ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
96902025-04-30T06:30:03.465ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
96912025-04-30T06:30:03.465ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96922025-04-30T06:30:03.468ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
96932025-04-30T06:30:03.468ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
96942025-04-30T06:30:03.472ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
96952025-04-30T06:30:03.474ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96962025-04-30T06:30:03.480ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
96972025-04-30T06:30:03.480ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
96982025-04-30T06:30:03.480ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
96992025-04-30T06:30:03.481ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
97002025-04-30T06:30:03.487ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97012025-04-30T06:30:03.493ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
97022025-04-30T06:30:03.493ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
97032025-04-30T06:30:03.494ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
97042025-04-30T06:30:03.494ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
97052025-04-30T06:30:03.564ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
97062025-04-30T06:30:03.564ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
97072025-04-30T06:30:03.567ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
97082025-04-30T06:30:03.567ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
97092025-04-30T06:30:03.568ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
97102025-04-30T06:30:03.570ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:44862 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
97112025-04-30T06:30:03.570ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
97122025-04-30T06:30:03.570ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
97132025-04-30T06:30:03.571ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
97142025-04-30T06:30:03.572ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
97152025-04-30T06:30:03.574ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:44862 req_id = 72ba6908-fc67-4a84-9b0d-929b581f16ec sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
97162025-04-30T06:30:03.577ZINFOtest_image_create (dropshot): request completed latency_us = 3912 local_addr = [::1]:42828 method = GET remote_addr = [::1]:44862 req_id = 72ba6908-fc67-4a84-9b0d-929b581f16ec response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
97172025-04-30T06:30:03.581ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "72ba6908-fc67-4a84-9b0d-929b581f16ec", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97182025-04-30T06:30:03.583ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
97192025-04-30T06:30:03.583ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
97202025-04-30T06:30:03.583ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
97212025-04-30T06:30:03.585ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
97222025-04-30T06:30:03.587ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97232025-04-30T06:30:03.587ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
97242025-04-30T06:30:03.587ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
97252025-04-30T06:30:03.587ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
97262025-04-30T06:30:03.588ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
97272025-04-30T06:30:03.588ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
97282025-04-30T06:30:03.593ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97292025-04-30T06:30:03.597ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
97302025-04-30T06:30:03.597ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
97312025-04-30T06:30:03.598ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
97322025-04-30T06:30:03.598ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
97332025-04-30T06:30:03.600ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
97342025-04-30T06:30:03.600ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
97352025-04-30T06:30:03.671ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
97362025-04-30T06:30:03.673ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
97372025-04-30T06:30:03.673ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
97382025-04-30T06:30:03.675ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
97392025-04-30T06:30:03.675ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 564.491893ms iteration = 33 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
97402025-04-30T06:30:03.675ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 34 reason = Signaled
97412025-04-30T06:30:03.675ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
97422025-04-30T06:30:03.675ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97432025-04-30T06:30:03.675ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
97442025-04-30T06:30:03.675ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
97452025-04-30T06:30:03.677ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
97462025-04-30T06:30:03.682ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97472025-04-30T06:30:03.698ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
97482025-04-30T06:30:03.699ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
97492025-04-30T06:30:03.699ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
97502025-04-30T06:30:03.699ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
97512025-04-30T06:30:03.705ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
97522025-04-30T06:30:03.705ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
97532025-04-30T06:30:03.705ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: fb 08 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:59027 req_id = 61b965d7-86af-415c-9396-a4ae9b3b8b80
97542025-04-30T06:30:03.705ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64264,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59027 req_id = 61b965d7-86af-415c-9396-a4ae9b3b8b80
97552025-04-30T06:30:03.706ZDEBGtest_image_create (store): query key key = _mgs._tcp
97562025-04-30T06:30:03.706ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
97572025-04-30T06:30:03.706ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:59027 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 61b965d7-86af-415c-9396-a4ae9b3b8b80
97582025-04-30T06:30:03.707ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3468, tv_nsec: 506369290 } })
97592025-04-30T06:30:03.707ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
97602025-04-30T06:30:03.708ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 6b 99 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e k...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:58236 req_id = 817bebfa-c2e1-4e24-8602-e345c7271027
97612025-04-30T06:30:03.708ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 27545,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58236 req_id = 817bebfa-c2e1-4e24-8602-e345c7271027
97622025-04-30T06:30:03.708ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
97632025-04-30T06:30:03.708ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:58236 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 817bebfa-c2e1-4e24-8602-e345c7271027
97642025-04-30T06:30:03.776ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
97652025-04-30T06:30:03.776ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
97662025-04-30T06:30:03.776ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97672025-04-30T06:30:03.776ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
97682025-04-30T06:30:03.776ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
97692025-04-30T06:30:03.777ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
97702025-04-30T06:30:03.777ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: ff 45 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .E..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:59088 req_id = 3041ed33-0d4d-4b7a-88fe-22d40cd0b713
97712025-04-30T06:30:03.777ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 65349,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59088 req_id = 3041ed33-0d4d-4b7a-88fe-22d40cd0b713
97722025-04-30T06:30:03.778ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
97732025-04-30T06:30:03.778ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65349, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59088 req_id = 3041ed33-0d4d-4b7a-88fe-22d40cd0b713
97742025-04-30T06:30:03.778ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
97752025-04-30T06:30:03.778ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
97762025-04-30T06:30:03.778ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
97772025-04-30T06:30:03.780ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97782025-04-30T06:30:03.785ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
97792025-04-30T06:30:03.785ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
97802025-04-30T06:30:03.785ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
97812025-04-30T06:30:03.786ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
97822025-04-30T06:30:03.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "73fd93ab-7e74-47e1-9d80-5abca497edf0", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97832025-04-30T06:30:03.786ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
97842025-04-30T06:30:03.788ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4115db30-96af-4d98-a4fa-39d87281fdc4", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97852025-04-30T06:30:03.788ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
97862025-04-30T06:30:03.788ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
97872025-04-30T06:30:03.788ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
97882025-04-30T06:30:03.789ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
97892025-04-30T06:30:03.793ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "83ec13bd-7602-44b1-9dec-88b3dd4fba8d", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97902025-04-30T06:30:03.793ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
97912025-04-30T06:30:03.798ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e225eac-654f-46a8-bec4-9929857c10ba", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97922025-04-30T06:30:03.798ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
97932025-04-30T06:30:03.804ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "47b0c24a-1afc-444d-bc74-c145ef5e9686", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97942025-04-30T06:30:03.804ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
97952025-04-30T06:30:03.806ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3766ca46-74eb-4938-be1e-c8700ce95736", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97962025-04-30T06:30:03.807ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
97972025-04-30T06:30:03.808ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b60ac98f-d0ec-46ad-96cf-bd0ada992458", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
97982025-04-30T06:30:03.808ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
97992025-04-30T06:30:03.819ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcf545ba-7126-4782-a348-c92df190148e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98002025-04-30T06:30:03.820ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
98012025-04-30T06:30:03.821ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "58989294-2629-4da6-aa4b-c9ec2815bae1", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98022025-04-30T06:30:03.821ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
98032025-04-30T06:30:03.824ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9417ec0-03e3-4975-8ab2-cca2524fe85c", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98042025-04-30T06:30:03.824ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
98052025-04-30T06:30:03.826ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "db33c8c7-2c63-48b3-8a04-0bfa2455830e", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98062025-04-30T06:30:03.826ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
98072025-04-30T06:30:03.829ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "22635757-b8c0-4ea5-b9ef-a2b342ea3ff9", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98082025-04-30T06:30:03.829ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
98092025-04-30T06:30:03.831ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2a629d-962d-4b02-9248-cd9cdd8ca2c6", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98102025-04-30T06:30:03.831ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
98112025-04-30T06:30:03.836ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
98122025-04-30T06:30:03.841ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "45d1e1b5-79ba-4ed5-b46b-b62974a0cc37", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98132025-04-30T06:30:03.841ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
98142025-04-30T06:30:03.844ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2c91382-f773-4387-b26b-7c20857dac11", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98152025-04-30T06:30:03.844ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
98162025-04-30T06:30:03.848ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba035532-cf08-44ff-b8a9-c123eb2fba60", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98172025-04-30T06:30:03.849ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
98182025-04-30T06:30:03.856ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c85fab4-01e8-4f04-bc21-f320529aa430", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98192025-04-30T06:30:03.856ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
98202025-04-30T06:30:03.858ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "246516bf-a164-4c22-af77-d9be71bca21d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98212025-04-30T06:30:03.859ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
98222025-04-30T06:30:03.864ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "33cdcf62-8ebf-4e3b-97b0-0c8a535fb973", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98232025-04-30T06:30:03.865ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
98242025-04-30T06:30:03.866ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d4c10a3-6cdf-4d47-91c1-39ecad58485d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98252025-04-30T06:30:03.866ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
98262025-04-30T06:30:03.868ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "826f6d83-07dd-4931-9dbb-123fc2b5b915", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98272025-04-30T06:30:03.868ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
98282025-04-30T06:30:03.872ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d2bef1c-1205-4a5f-9aaf-11b8883af58f", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98292025-04-30T06:30:03.872ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
98302025-04-30T06:30:03.873ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f5f4d27-9965-4c22-8d56-d1cfed0aa495", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98312025-04-30T06:30:03.873ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
98322025-04-30T06:30:03.875ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d895626-3db5-4914-943b-5d331566c077", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98332025-04-30T06:30:03.876ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
98342025-04-30T06:30:03.878ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f1300e1-a958-4e81-8452-8efee0172bf8", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98352025-04-30T06:30:03.878ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
98362025-04-30T06:30:03.881ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "74dcb517-2ce0-4766-8cf7-add917d8784e", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98372025-04-30T06:30:03.881ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
98382025-04-30T06:30:03.884ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "43d1576a-bee3-4e68-b2e1-6bd463a70e96", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98392025-04-30T06:30:03.884ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
98402025-04-30T06:30:03.887ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
98412025-04-30T06:30:03.887ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98422025-04-30T06:30:03.887ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
98432025-04-30T06:30:03.887ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
98442025-04-30T06:30:03.888ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
98452025-04-30T06:30:03.891ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "284a699b-4ccf-47ed-b4a0-bd25cea087d2", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98462025-04-30T06:30:03.891ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
98472025-04-30T06:30:03.892ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98482025-04-30T06:30:03.905ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
98492025-04-30T06:30:03.905ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
98502025-04-30T06:30:03.905ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
98512025-04-30T06:30:03.907ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
98522025-04-30T06:30:03.911ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
98532025-04-30T06:30:03.911ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
98542025-04-30T06:30:03.913ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
98552025-04-30T06:30:03.913ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdfbbe3f-714e-407a-8dc0-df16bcdbfbfd", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98562025-04-30T06:30:03.914ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
98572025-04-30T06:30:03.919ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "44922868-5944-48aa-94c3-8ddcdfbe5c05", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98582025-04-30T06:30:03.920ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
98592025-04-30T06:30:03.921ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "263be137-9eff-421e-b2cf-2bda67bc65d2", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98602025-04-30T06:30:03.921ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
98612025-04-30T06:30:03.923ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce87db5d-093e-41e5-95e9-5e0a1960219a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98622025-04-30T06:30:03.923ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
98632025-04-30T06:30:03.925ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bb33d68-f352-46ad-be0a-5d8fff3a1bb0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98642025-04-30T06:30:03.926ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
98652025-04-30T06:30:03.927ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "31c307e0-87e9-4d7d-b4ad-3c6869d5ffff", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98662025-04-30T06:30:03.927ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
98672025-04-30T06:30:03.931ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c79a8178-70a3-4517-8d42-aa8f75bee374", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98682025-04-30T06:30:03.931ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
98692025-04-30T06:30:03.934ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4602e66-e50e-4f7f-859f-164108c356c8", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98702025-04-30T06:30:03.934ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
98712025-04-30T06:30:03.938ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d2df785-4f25-41f8-b581-729460c046d6", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98722025-04-30T06:30:03.938ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
98732025-04-30T06:30:03.945ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
98742025-04-30T06:30:03.946ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "35db2783-d178-43ea-94eb-a4237cd7e9ec", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98752025-04-30T06:30:03.946ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
98762025-04-30T06:30:03.950ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7241b9d5-c6d5-4bf4-b4af-2712b6842f1d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98772025-04-30T06:30:03.951ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
98782025-04-30T06:30:03.954ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "07a43fb2-9b53-4006-9937-b1fb6f8193ec", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98792025-04-30T06:30:03.954ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
98802025-04-30T06:30:03.958ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97b24dee-1fbf-46f5-803e-971b24f7f3ee", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98812025-04-30T06:30:03.958ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
98822025-04-30T06:30:03.963ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa4026d9-9c35-4efc-8d52-03f8a6e2d462", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98832025-04-30T06:30:03.963ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
98842025-04-30T06:30:03.965ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e7f1e8c-9181-420b-81d3-f8fddea553e0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98852025-04-30T06:30:03.965ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
98862025-04-30T06:30:03.968ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b109adaa-2393-4ee3-acc8-4dff39ff6c04", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98872025-04-30T06:30:03.968ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
98882025-04-30T06:30:03.969ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e14abadc-ab40-4119-b686-332a365c56b4", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
98892025-04-30T06:30:03.969ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
98902025-04-30T06:30:03.969ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98912025-04-30T06:30:03.969ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
98922025-04-30T06:30:03.969ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
98932025-04-30T06:30:03.971ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
98942025-04-30T06:30:03.976ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98952025-04-30T06:30:03.984ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
98962025-04-30T06:30:03.984ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
98972025-04-30T06:30:03.984ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98982025-04-30T06:30:03.984ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
98992025-04-30T06:30:03.984ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99002025-04-30T06:30:03.988ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99012025-04-30T06:30:03.995ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99022025-04-30T06:30:04.006ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
99032025-04-30T06:30:04.006ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
99042025-04-30T06:30:04.006ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99052025-04-30T06:30:04.007ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99062025-04-30T06:30:04.007ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
99072025-04-30T06:30:04.007ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99082025-04-30T06:30:04.007ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
99092025-04-30T06:30:04.007ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
99102025-04-30T06:30:04.008ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
99112025-04-30T06:30:04.085ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
99122025-04-30T06:30:04.085ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
99132025-04-30T06:30:04.085ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:61031 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
99142025-04-30T06:30:04.086ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:61031 req_id = 793e978e-72d3-407e-b245-dc52e9f9e658 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
99152025-04-30T06:30:04.087ZINFOtest_image_create (dropshot): request completed latency_us = 678 local_addr = [::1]:42828 method = GET remote_addr = [::1]:61031 req_id = 793e978e-72d3-407e-b245-dc52e9f9e658 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
99162025-04-30T06:30:04.087ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99172025-04-30T06:30:04.094ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
99182025-04-30T06:30:04.095ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
99192025-04-30T06:30:04.095ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
99202025-04-30T06:30:04.095ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
99212025-04-30T06:30:04.096ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "793e978e-72d3-407e-b245-dc52e9f9e658", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
99222025-04-30T06:30:04.098ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
99232025-04-30T06:30:04.099ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
99242025-04-30T06:30:04.099ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
99252025-04-30T06:30:04.102ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
99262025-04-30T06:30:04.102ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99272025-04-30T06:30:04.102ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
99282025-04-30T06:30:04.102ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99292025-04-30T06:30:04.103ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99302025-04-30T06:30:04.110ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
99312025-04-30T06:30:04.110ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
99322025-04-30T06:30:04.111ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
99332025-04-30T06:30:04.112ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99342025-04-30T06:30:04.118ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
99352025-04-30T06:30:04.118ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
99362025-04-30T06:30:04.118ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99372025-04-30T06:30:04.118ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99382025-04-30T06:30:04.179ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
99392025-04-30T06:30:04.180ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
99402025-04-30T06:30:04.180ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 506.223878ms iteration = 34 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
99412025-04-30T06:30:04.180ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 35 reason = Signaled
99422025-04-30T06:30:04.180ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
99432025-04-30T06:30:04.180ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99442025-04-30T06:30:04.181ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
99452025-04-30T06:30:04.181ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99462025-04-30T06:30:04.182ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99472025-04-30T06:30:04.185ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
99482025-04-30T06:30:04.186ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99492025-04-30T06:30:04.197ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
99502025-04-30T06:30:04.197ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
99512025-04-30T06:30:04.197ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99522025-04-30T06:30:04.198ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99532025-04-30T06:30:04.202ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
99542025-04-30T06:30:04.202ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
99552025-04-30T06:30:04.204ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 6a 49 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 jI..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:57578 req_id = 849a0171-56b7-4140-94c5-7ded968a5573
99562025-04-30T06:30:04.204ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 27209,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57578 req_id = 849a0171-56b7-4140-94c5-7ded968a5573
99572025-04-30T06:30:04.204ZDEBGtest_image_create (store): query key key = _mgs._tcp
99582025-04-30T06:30:04.205ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
99592025-04-30T06:30:04.205ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:57578 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 849a0171-56b7-4140-94c5-7ded968a5573
99602025-04-30T06:30:04.205ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3469, tv_nsec: 4920310 } })
99612025-04-30T06:30:04.207ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
99622025-04-30T06:30:04.207ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 91 8d 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:54863 req_id = 1d19acc6-6564-4223-9cd3-2257ab965341
99632025-04-30T06:30:04.208ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 37261,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54863 req_id = 1d19acc6-6564-4223-9cd3-2257ab965341
99642025-04-30T06:30:04.208ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
99652025-04-30T06:30:04.208ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:54863 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 1d19acc6-6564-4223-9cd3-2257ab965341
99662025-04-30T06:30:04.275ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
99672025-04-30T06:30:04.278ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
99682025-04-30T06:30:04.278ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99692025-04-30T06:30:04.278ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
99702025-04-30T06:30:04.278ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
99712025-04-30T06:30:04.279ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
99722025-04-30T06:30:04.280ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 18 f3 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:60675 req_id = 571e8b93-0214-497a-aad2-f720af0edb3b
99732025-04-30T06:30:04.280ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 6387,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60675 req_id = 571e8b93-0214-497a-aad2-f720af0edb3b
99742025-04-30T06:30:04.281ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
99752025-04-30T06:30:04.281ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6387, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:60675 req_id = 571e8b93-0214-497a-aad2-f720af0edb3b
99762025-04-30T06:30:04.281ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
99772025-04-30T06:30:04.281ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
99782025-04-30T06:30:04.281ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
99792025-04-30T06:30:04.283ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99802025-04-30T06:30:04.296ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
99812025-04-30T06:30:04.296ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
99822025-04-30T06:30:04.296ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
99832025-04-30T06:30:04.296ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
99842025-04-30T06:30:04.299ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "50c4cf4a-b263-4ab9-a57f-233b5417b90f", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
99852025-04-30T06:30:04.300ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
99862025-04-30T06:30:04.301ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
99872025-04-30T06:30:04.301ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
99882025-04-30T06:30:04.302ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
99892025-04-30T06:30:04.306ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "848518e1-6638-4bfe-99b5-ec557ec66cbc", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
99902025-04-30T06:30:04.307ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
99912025-04-30T06:30:04.310ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "814e6281-28f0-4940-a4d5-bd3f46bec8ce", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
99922025-04-30T06:30:04.311ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
99932025-04-30T06:30:04.314ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "212ef628-556e-444d-a2ae-675c2f25eec0", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
99942025-04-30T06:30:04.314ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
99952025-04-30T06:30:04.319ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb3e6eb-dc66-4325-a8e1-45fcb5cf85f9", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
99962025-04-30T06:30:04.319ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
99972025-04-30T06:30:04.321ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbddb567-b866-490f-af36-4ace29bb3760", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
99982025-04-30T06:30:04.321ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
99992025-04-30T06:30:04.322ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6043612-4d46-450a-90ff-5ec8c993faaf", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100002025-04-30T06:30:04.323ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
100012025-04-30T06:30:04.325ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "697c2091-2818-4026-b3e8-69d4f9d83abd", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100022025-04-30T06:30:04.326ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
100032025-04-30T06:30:04.327ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1d1a60b-b37e-4eef-a6fa-b36dd43b4634", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100042025-04-30T06:30:04.328ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
100052025-04-30T06:30:04.332ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d1fe8ab-2ced-4792-9b56-f59da7976ec2", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100062025-04-30T06:30:04.333ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
100072025-04-30T06:30:04.334ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ecef816-7b9c-4a5c-812b-9e7abebf67cd", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100082025-04-30T06:30:04.335ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
100092025-04-30T06:30:04.336ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "50f61a0e-da15-4e7c-a3b9-d410bedd96d9", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100102025-04-30T06:30:04.336ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
100112025-04-30T06:30:04.342ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d73b49e7-d803-4ba1-9a9e-27870a826545", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100122025-04-30T06:30:04.342ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
100132025-04-30T06:30:04.343ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
100142025-04-30T06:30:04.345ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf1897b2-b16b-4e84-a2ce-c06b66dc0a65", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100152025-04-30T06:30:04.345ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
100162025-04-30T06:30:04.347ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a193f3b2-b8d2-45d5-b2af-7c2fd15a2040", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100172025-04-30T06:30:04.348ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
100182025-04-30T06:30:04.353ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "32c097fb-6731-4be0-af25-27c2680ed3ee", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100192025-04-30T06:30:04.354ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
100202025-04-30T06:30:04.356ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "938f114e-e9a2-4a93-9862-a28f83e427cf", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100212025-04-30T06:30:04.356ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
100222025-04-30T06:30:04.358ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec10b1a0-f43c-428d-91f7-c7bd13e23ff9", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:03 GMT"} })
100232025-04-30T06:30:04.359ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
100242025-04-30T06:30:04.363ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b6a29df-0049-42d7-b1a5-88321eac7f5d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100252025-04-30T06:30:04.363ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
100262025-04-30T06:30:04.363ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d73b34d-c339-4d4c-a475-b3cd1d3765a8", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100272025-04-30T06:30:04.363ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
100282025-04-30T06:30:04.363ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ef764c-0096-4813-9cda-555fe51f5a89", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100292025-04-30T06:30:04.363ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
100302025-04-30T06:30:04.365ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6614ce56-b698-4cb4-8c82-873a23d4a0a4", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100312025-04-30T06:30:04.365ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
100322025-04-30T06:30:04.367ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1dd1645-a8f4-4c3f-a0da-998ab7c347d4", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100332025-04-30T06:30:04.368ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
100342025-04-30T06:30:04.369ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "990aa7f3-1a40-4146-b4c5-82b2f6be0182", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100352025-04-30T06:30:04.370ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
100362025-04-30T06:30:04.372ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0646e81-5b34-4be1-833f-fed464cef544", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100372025-04-30T06:30:04.372ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
100382025-04-30T06:30:04.373ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "55e42607-6e87-4dd0-9ea8-b7fd58a3bc59", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100392025-04-30T06:30:04.373ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
100402025-04-30T06:30:04.375ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "762d4e35-6f0a-4596-bc49-d15d01f87966", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100412025-04-30T06:30:04.375ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
100422025-04-30T06:30:04.381ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9203f57f-1720-4f06-a323-79183bdc269f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100432025-04-30T06:30:04.381ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
100442025-04-30T06:30:04.386ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "33ceda6a-5a33-477c-ac3d-7b001daa65fb", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100452025-04-30T06:30:04.386ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
100462025-04-30T06:30:04.394ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
100472025-04-30T06:30:04.394ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100482025-04-30T06:30:04.394ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
100492025-04-30T06:30:04.394ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
100502025-04-30T06:30:04.396ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
100512025-04-30T06:30:04.399ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa771dc0-0b51-4599-b7dc-51bb6832b207", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100522025-04-30T06:30:04.400ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
100532025-04-30T06:30:04.400ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100542025-04-30T06:30:04.413ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
100552025-04-30T06:30:04.413ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
100562025-04-30T06:30:04.414ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
100572025-04-30T06:30:04.417ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
100582025-04-30T06:30:04.432ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
100592025-04-30T06:30:04.433ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
100602025-04-30T06:30:04.434ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
100612025-04-30T06:30:04.435ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
100622025-04-30T06:30:04.438ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
100632025-04-30T06:30:04.443ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "43011518-690c-4480-b8d3-26f548467622", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100642025-04-30T06:30:04.443ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
100652025-04-30T06:30:04.444ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
100662025-04-30T06:30:04.446ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
100672025-04-30T06:30:04.446ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
100682025-04-30T06:30:04.446ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
100692025-04-30T06:30:04.448ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f0df523-93be-4fd3-8234-68209c8b58c9", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100702025-04-30T06:30:04.448ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
100712025-04-30T06:30:04.451ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "021f98db-64f6-4475-b572-0ee5521d119e", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100722025-04-30T06:30:04.451ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
100732025-04-30T06:30:04.454ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2bbec53-a8ca-4ec0-9005-b9d6c73111f6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100742025-04-30T06:30:04.454ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
100752025-04-30T06:30:04.456ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1235ea4a-dd24-4528-8580-49fde774ad48", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100762025-04-30T06:30:04.456ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
100772025-04-30T06:30:04.460ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e4d8af5-678c-4fa1-8c10-18c6a947dc35", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100782025-04-30T06:30:04.460ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
100792025-04-30T06:30:04.464ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d4bf1b9-996e-44e5-9951-b78abca20012", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100802025-04-30T06:30:04.465ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
100812025-04-30T06:30:04.470ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "60b7dd67-aa42-4f80-9b3a-d4a6e1664cdb", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100822025-04-30T06:30:04.471ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
100832025-04-30T06:30:04.476ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "78aee3ed-19ad-43e6-8580-9b3e95c9b040", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100842025-04-30T06:30:04.477ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
100852025-04-30T06:30:04.481ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a88eb681-a020-4b9b-bcd9-77a78d503c8d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100862025-04-30T06:30:04.481ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
100872025-04-30T06:30:04.503ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
100882025-04-30T06:30:04.518ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
100892025-04-30T06:30:04.518ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
100902025-04-30T06:30:04.519ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
100912025-04-30T06:30:04.519ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
100922025-04-30T06:30:04.523ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a372100-ddf5-40e3-a8db-fe61bad7823d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100932025-04-30T06:30:04.525ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
100942025-04-30T06:30:04.530ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
100952025-04-30T06:30:04.530ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
100962025-04-30T06:30:04.533ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2926f120-adcb-40e9-baa2-c54154c30e29", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
100972025-04-30T06:30:04.533ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
100982025-04-30T06:30:04.533ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
100992025-04-30T06:30:04.534ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
101002025-04-30T06:30:04.542ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a13a988-7ff5-47c8-af96-041fe1d10042", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
101012025-04-30T06:30:04.542ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
101022025-04-30T06:30:04.544ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1a17804-5d4b-4750-93c6-001b531ed7cc", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
101032025-04-30T06:30:04.544ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
101042025-04-30T06:30:04.547ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8201daa-767b-4de7-add8-721e86dee630", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
101052025-04-30T06:30:04.547ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
101062025-04-30T06:30:04.548ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101072025-04-30T06:30:04.548ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
101082025-04-30T06:30:04.548ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101092025-04-30T06:30:04.549ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101102025-04-30T06:30:04.555ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
101112025-04-30T06:30:04.555ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101122025-04-30T06:30:04.555ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
101132025-04-30T06:30:04.555ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
101142025-04-30T06:30:04.556ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
101152025-04-30T06:30:04.556ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101162025-04-30T06:30:04.568ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
101172025-04-30T06:30:04.568ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
101182025-04-30T06:30:04.568ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101192025-04-30T06:30:04.568ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
101202025-04-30T06:30:04.568ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101212025-04-30T06:30:04.568ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101222025-04-30T06:30:04.571ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101232025-04-30T06:30:04.583ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
101242025-04-30T06:30:04.583ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
101252025-04-30T06:30:04.583ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
101262025-04-30T06:30:04.584ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
101272025-04-30T06:30:04.585ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101282025-04-30T06:30:04.592ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
101292025-04-30T06:30:04.593ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
101302025-04-30T06:30:04.593ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101312025-04-30T06:30:04.593ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101322025-04-30T06:30:04.602ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
101332025-04-30T06:30:04.602ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
101342025-04-30T06:30:04.604ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
101352025-04-30T06:30:04.686ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
101362025-04-30T06:30:04.686ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
101372025-04-30T06:30:04.687ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:55181 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
101382025-04-30T06:30:04.687ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
101392025-04-30T06:30:04.688ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:55181 req_id = 17ed9981-a039-4212-9675-b6b725faa906 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
101402025-04-30T06:30:04.689ZINFOtest_image_create (dropshot): request completed latency_us = 1083 local_addr = [::1]:42828 method = GET remote_addr = [::1]:55181 req_id = 17ed9981-a039-4212-9675-b6b725faa906 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
101412025-04-30T06:30:04.691ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "17ed9981-a039-4212-9675-b6b725faa906", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
101422025-04-30T06:30:04.704ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
101432025-04-30T06:30:04.704ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
101442025-04-30T06:30:04.704ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
101452025-04-30T06:30:04.710ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
101462025-04-30T06:30:04.711ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101472025-04-30T06:30:04.711ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
101482025-04-30T06:30:04.711ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101492025-04-30T06:30:04.712ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101502025-04-30T06:30:04.716ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101512025-04-30T06:30:04.723ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
101522025-04-30T06:30:04.724ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
101532025-04-30T06:30:04.724ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101542025-04-30T06:30:04.725ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101552025-04-30T06:30:04.751ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
101562025-04-30T06:30:04.773ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
101572025-04-30T06:30:04.773ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
101582025-04-30T06:30:04.774ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 593.445051ms iteration = 35 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
101592025-04-30T06:30:04.774ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 36 reason = Signaled
101602025-04-30T06:30:04.775ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
101612025-04-30T06:30:04.775ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101622025-04-30T06:30:04.775ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
101632025-04-30T06:30:04.775ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101642025-04-30T06:30:04.780ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101652025-04-30T06:30:04.785ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101662025-04-30T06:30:04.791ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
101672025-04-30T06:30:04.791ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
101682025-04-30T06:30:04.792ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101692025-04-30T06:30:04.793ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101702025-04-30T06:30:04.797ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
101712025-04-30T06:30:04.797ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
101722025-04-30T06:30:04.799ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: cd 14 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:56211 req_id = 40183a92-26e3-4d55-9676-b4362b6b219c
101732025-04-30T06:30:04.799ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52500,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56211 req_id = 40183a92-26e3-4d55-9676-b4362b6b219c
101742025-04-30T06:30:04.799ZDEBGtest_image_create (store): query key key = _mgs._tcp
101752025-04-30T06:30:04.800ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
101762025-04-30T06:30:04.800ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:56211 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 40183a92-26e3-4d55-9676-b4362b6b219c
101772025-04-30T06:30:04.800ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3469, tv_nsec: 599597536 } })
101782025-04-30T06:30:04.800ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
101792025-04-30T06:30:04.801ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: db aa 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:64832 req_id = 3203b1ca-1ce7-43cc-908c-e72b0360f5cf
101802025-04-30T06:30:04.801ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56234,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64832 req_id = 3203b1ca-1ce7-43cc-908c-e72b0360f5cf
101812025-04-30T06:30:04.801ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
101822025-04-30T06:30:04.801ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:64832 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 3203b1ca-1ce7-43cc-908c-e72b0360f5cf
101832025-04-30T06:30:04.878ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
101842025-04-30T06:30:04.878ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
101852025-04-30T06:30:04.878ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101862025-04-30T06:30:04.879ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
101872025-04-30T06:30:04.879ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
101882025-04-30T06:30:04.880ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
101892025-04-30T06:30:04.883ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 6f 07 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c o............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:59490 req_id = a41207b2-0ea2-475b-94fa-f679f449f150
101902025-04-30T06:30:04.883ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 28423,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59490 req_id = a41207b2-0ea2-475b-94fa-f679f449f150
101912025-04-30T06:30:04.883ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
101922025-04-30T06:30:04.883ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28423, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59490 req_id = a41207b2-0ea2-475b-94fa-f679f449f150
101932025-04-30T06:30:04.885ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
101942025-04-30T06:30:04.885ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
101952025-04-30T06:30:04.885ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
101962025-04-30T06:30:04.887ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101972025-04-30T06:30:04.899ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
101982025-04-30T06:30:04.899ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
101992025-04-30T06:30:04.900ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
102002025-04-30T06:30:04.900ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
102012025-04-30T06:30:04.905ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
102022025-04-30T06:30:04.905ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
102032025-04-30T06:30:04.906ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
102042025-04-30T06:30:04.907ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c87af42-d5dc-4f9e-9c62-03fdebfd10e3", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102052025-04-30T06:30:04.909ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
102062025-04-30T06:30:04.910ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "87b8167a-0288-4456-b95e-e7f5b30797c2", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102072025-04-30T06:30:04.910ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
102082025-04-30T06:30:04.913ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "14c26dd4-dfe7-4d31-a54a-3f6cbfcae327", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102092025-04-30T06:30:04.913ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
102102025-04-30T06:30:04.916ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0bd055a-2a97-45aa-a10b-fe8470559bf1", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102112025-04-30T06:30:04.917ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
102122025-04-30T06:30:04.928ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c3883bd-c89f-4a3d-b798-d0952ee9b7f9", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102132025-04-30T06:30:04.928ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
102142025-04-30T06:30:04.931ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "009d6d50-53ee-4d56-93df-4fdabe067600", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102152025-04-30T06:30:04.931ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
102162025-04-30T06:30:04.935ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "35baa2a1-0b05-404c-acc9-d5c7fef62c48", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102172025-04-30T06:30:04.935ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
102182025-04-30T06:30:04.946ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5214d992-92c0-4a19-8d4b-41416ea235b8", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102192025-04-30T06:30:04.946ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
102202025-04-30T06:30:04.947ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3cd803c-0998-48bf-9447-aa1a5790352a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102212025-04-30T06:30:04.947ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
102222025-04-30T06:30:04.949ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0386e16f-8b4a-4ff8-8bad-46a67ce8d211", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102232025-04-30T06:30:04.949ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
102242025-04-30T06:30:04.950ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "30615fee-8028-496a-b175-5c16ba0d5481", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102252025-04-30T06:30:04.951ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
102262025-04-30T06:30:04.954ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
102272025-04-30T06:30:04.954ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b34bee20-7ce5-4ada-b815-4e6a8f2d956f", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102282025-04-30T06:30:04.954ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
102292025-04-30T06:30:04.956ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f3800a0-e88d-4519-bf0e-78e52d8089e3", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102302025-04-30T06:30:04.956ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
102312025-04-30T06:30:04.959ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ece3439e-32a7-4c3e-ac75-df10ee82f26b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102322025-04-30T06:30:04.959ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
102332025-04-30T06:30:04.962ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "85f681d8-5276-474b-ab31-31eef0d9b147", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102342025-04-30T06:30:04.963ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
102352025-04-30T06:30:04.966ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea17e40c-8be6-4a80-8298-852f3dd07012", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102362025-04-30T06:30:04.966ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
102372025-04-30T06:30:04.969ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "caad600d-8a80-4ef8-86c8-4f3fc1a482ab", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102382025-04-30T06:30:04.969ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
102392025-04-30T06:30:04.972ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4455886-ed76-490b-817b-5120b2aff1f4", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102402025-04-30T06:30:04.973ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
102412025-04-30T06:30:04.976ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8c71858-28ce-4288-bf17-cd976fb03f0f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102422025-04-30T06:30:04.976ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
102432025-04-30T06:30:04.977ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "97868a3f-1788-45d7-a4ba-7ef5d0d7518e", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102442025-04-30T06:30:04.978ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
102452025-04-30T06:30:04.979ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53c9477-bf86-4882-8230-0e1db777fbff", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102462025-04-30T06:30:04.979ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
102472025-04-30T06:30:04.981ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "53bb0aab-e0d2-4f66-833a-55ad4f76bc91", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102482025-04-30T06:30:04.981ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
102492025-04-30T06:30:04.982ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6656548b-e7e9-45a2-82df-866beff923e6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102502025-04-30T06:30:04.982ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
102512025-04-30T06:30:04.984ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d012b47f-7d28-4954-a857-5d1295a63abb", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102522025-04-30T06:30:04.984ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
102532025-04-30T06:30:04.989ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb80835a-3b14-41b3-9fd8-9d59387bd2f3", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102542025-04-30T06:30:04.989ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
102552025-04-30T06:30:04.992ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac4d9b2a-6b28-4843-ae7b-3b40f6cca7d2", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102562025-04-30T06:30:04.993ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
102572025-04-30T06:30:04.998ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "32444770-a650-45dd-8f87-b2fcae7dfadd", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102582025-04-30T06:30:04.998ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
102592025-04-30T06:30:05.001ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b2f4988-c317-425a-a639-60531f90746a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102602025-04-30T06:30:05.001ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
102612025-04-30T06:30:05.005ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
102622025-04-30T06:30:05.005ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
102632025-04-30T06:30:05.005ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
102642025-04-30T06:30:05.005ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
102652025-04-30T06:30:05.019ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
102662025-04-30T06:30:05.020ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eee24c6a-ce7e-41d6-be13-e901116bf6c3", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102672025-04-30T06:30:05.022ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
102682025-04-30T06:30:05.024ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102692025-04-30T06:30:05.048ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
102702025-04-30T06:30:05.048ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
102712025-04-30T06:30:05.048ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
102722025-04-30T06:30:05.049ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
102732025-04-30T06:30:05.054ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
102742025-04-30T06:30:05.054ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
102752025-04-30T06:30:05.057ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
102762025-04-30T06:30:05.061ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "368b3a33-d979-46e6-82db-b1365714edd8", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102772025-04-30T06:30:05.062ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
102782025-04-30T06:30:05.063ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6dd7988-39b1-490e-803f-23bcdbaa3be1", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102792025-04-30T06:30:05.063ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
102802025-04-30T06:30:05.065ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "122a947c-a8fb-4fe0-91f6-9d839d7d945b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102812025-04-30T06:30:05.065ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
102822025-04-30T06:30:05.068ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1da9c58c-cd17-469a-88bb-104732201ce3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102832025-04-30T06:30:05.069ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
102842025-04-30T06:30:05.071ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b200c2f2-4522-4f20-825b-a783dcaf2838", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102852025-04-30T06:30:05.071ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
102862025-04-30T06:30:05.075ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "42b7bcbf-ef48-4ec0-99a8-e35bb0371bad", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102872025-04-30T06:30:05.075ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
102882025-04-30T06:30:05.078ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8dc1ca4-736a-4687-a702-49fe4c09010b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102892025-04-30T06:30:05.078ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
102902025-04-30T06:30:05.082ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce83f74-8f6d-4f30-be85-1d7fee838e84", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102912025-04-30T06:30:05.082ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
102922025-04-30T06:30:05.087ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "76ce9437-e2c7-4610-92d9-14fb69d1bd2e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102932025-04-30T06:30:05.087ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
102942025-04-30T06:30:05.091ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
102952025-04-30T06:30:05.092ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae245fcf-4e7b-43bd-9528-d503033bdf86", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102962025-04-30T06:30:05.092ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
102972025-04-30T06:30:05.095ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "03917a93-67d7-4d4d-962e-a9d68be0d651", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
102982025-04-30T06:30:05.095ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
102992025-04-30T06:30:05.098ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "280ea45e-8837-49a9-bad9-1d3b772783fb", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
103002025-04-30T06:30:05.098ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
103012025-04-30T06:30:05.099ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa847842-70bb-4ee9-b6d4-ea5bcd9babc5", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
103022025-04-30T06:30:05.099ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
103032025-04-30T06:30:05.100ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc95bbfd-3ab8-43fb-a8ba-fa4ae63c013f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
103042025-04-30T06:30:05.100ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
103052025-04-30T06:30:05.103ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca915bb5-08d3-4258-bcf0-410387a31d0d", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
103062025-04-30T06:30:05.103ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
103072025-04-30T06:30:05.108ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0581c06b-c180-4cfb-9a6b-12bcfbc348c4", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
103082025-04-30T06:30:05.108ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
103092025-04-30T06:30:05.108ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103102025-04-30T06:30:05.108ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
103112025-04-30T06:30:05.108ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103122025-04-30T06:30:05.109ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103132025-04-30T06:30:05.114ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103142025-04-30T06:30:05.128ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
103152025-04-30T06:30:05.128ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
103162025-04-30T06:30:05.128ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103172025-04-30T06:30:05.128ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
103182025-04-30T06:30:05.128ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103192025-04-30T06:30:05.130ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103202025-04-30T06:30:05.134ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103212025-04-30T06:30:05.147ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
103222025-04-30T06:30:05.147ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
103232025-04-30T06:30:05.147ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103242025-04-30T06:30:05.147ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103252025-04-30T06:30:05.148ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
103262025-04-30T06:30:05.148ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103272025-04-30T06:30:05.149ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
103282025-04-30T06:30:05.149ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
103292025-04-30T06:30:05.150ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
103302025-04-30T06:30:05.154ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312025-04-30T06:30:05.167ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
103322025-04-30T06:30:05.167ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
103332025-04-30T06:30:05.168ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
103342025-04-30T06:30:05.168ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
103352025-04-30T06:30:05.223ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
103362025-04-30T06:30:05.223ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
103372025-04-30T06:30:05.224ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:43904 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
103382025-04-30T06:30:05.226ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:43904 req_id = 2f8c05d6-9d31-4310-80de-81089bbe1a2f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
103392025-04-30T06:30:05.226ZINFOtest_image_create (dropshot): request completed latency_us = 449 local_addr = [::1]:42828 method = GET remote_addr = [::1]:43904 req_id = 2f8c05d6-9d31-4310-80de-81089bbe1a2f response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
103402025-04-30T06:30:05.226ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
103412025-04-30T06:30:05.226ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
103422025-04-30T06:30:05.226ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
103432025-04-30T06:30:05.226ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f8c05d6-9d31-4310-80de-81089bbe1a2f", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:04 GMT"} })
103442025-04-30T06:30:05.230ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
103452025-04-30T06:30:05.230ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
103462025-04-30T06:30:05.230ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
103472025-04-30T06:30:05.231ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
103482025-04-30T06:30:05.231ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103492025-04-30T06:30:05.231ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
103502025-04-30T06:30:05.232ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103512025-04-30T06:30:05.233ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103522025-04-30T06:30:05.238ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103532025-04-30T06:30:05.245ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
103542025-04-30T06:30:05.246ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
103552025-04-30T06:30:05.246ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103562025-04-30T06:30:05.247ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103572025-04-30T06:30:05.276ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
103582025-04-30T06:30:05.281ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
103592025-04-30T06:30:05.281ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
103602025-04-30T06:30:05.281ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 506.690087ms iteration = 36 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
103612025-04-30T06:30:05.281ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 37 reason = Signaled
103622025-04-30T06:30:05.281ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
103632025-04-30T06:30:05.281ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103642025-04-30T06:30:05.281ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
103652025-04-30T06:30:05.281ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103662025-04-30T06:30:05.282ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103672025-04-30T06:30:05.285ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103682025-04-30T06:30:05.291ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
103692025-04-30T06:30:05.291ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
103702025-04-30T06:30:05.291ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103712025-04-30T06:30:05.291ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103722025-04-30T06:30:05.295ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
103732025-04-30T06:30:05.295ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
103742025-04-30T06:30:05.296ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: b6 7d 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .}..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:53499 req_id = feb7b117-fac2-4be8-887d-093cbbe40b80
103752025-04-30T06:30:05.296ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 46717,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:53499 req_id = feb7b117-fac2-4be8-887d-093cbbe40b80
103762025-04-30T06:30:05.296ZDEBGtest_image_create (store): query key key = _mgs._tcp
103772025-04-30T06:30:05.298ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
103782025-04-30T06:30:05.299ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:53499 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = feb7b117-fac2-4be8-887d-093cbbe40b80
103792025-04-30T06:30:05.299ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3470, tv_nsec: 98610297 } })
103802025-04-30T06:30:05.299ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
103812025-04-30T06:30:05.300ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ed f9 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:49731 req_id = 774a1cdc-b2f9-4f44-88d6-822bb2896f9b
103822025-04-30T06:30:05.300ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60921,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49731 req_id = 774a1cdc-b2f9-4f44-88d6-822bb2896f9b
103832025-04-30T06:30:05.300ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
103842025-04-30T06:30:05.300ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:49731 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 774a1cdc-b2f9-4f44-88d6-822bb2896f9b
103852025-04-30T06:30:05.391ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
103862025-04-30T06:30:05.391ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
103872025-04-30T06:30:05.391ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103882025-04-30T06:30:05.391ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
103892025-04-30T06:30:05.391ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
103902025-04-30T06:30:05.393ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
103912025-04-30T06:30:05.393ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
103922025-04-30T06:30:05.394ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
103932025-04-30T06:30:05.394ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b77e4dc8-9dfd-4cbc-a616-38a98f86c161 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
103942025-04-30T06:30:05.394ZDEBGtest_image_create (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
103952025-04-30T06:30:05.395ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database
103962025-04-30T06:30:05.395ZDEBGtest_image_create (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103972025-04-30T06:30:05.396ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103982025-04-30T06:30:05.397ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: f2 87 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:61624 req_id = 0e506c8e-6a0d-484a-9026-ca7a55de5036
103992025-04-30T06:30:05.397ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62087,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61624 req_id = 0e506c8e-6a0d-484a-9026-ca7a55de5036
104002025-04-30T06:30:05.397ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
104012025-04-30T06:30:05.398ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62087, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:61624 req_id = 0e506c8e-6a0d-484a-9026-ca7a55de5036
104022025-04-30T06:30:05.399ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b77e4dc8-9dfd-4cbc-a616-38a98f86c161 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
104032025-04-30T06:30:05.399ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b77e4dc8-9dfd-4cbc-a616-38a98f86c161 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
104042025-04-30T06:30:05.400ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b77e4dc8-9dfd-4cbc-a616-38a98f86c161 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
104052025-04-30T06:30:05.400ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
104062025-04-30T06:30:05.401ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
104072025-04-30T06:30:05.401ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
104082025-04-30T06:30:05.401ZDEBGtest_image_create (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
104092025-04-30T06:30:05.401ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database
104102025-04-30T06:30:05.401ZDEBGtest_image_create (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104112025-04-30T06:30:05.402ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
104122025-04-30T06:30:05.402ZDEBGtest_image_create (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
104132025-04-30T06:30:05.403ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104142025-04-30T06:30:05.413ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
104152025-04-30T06:30:05.413ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
104162025-04-30T06:30:05.413ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
104172025-04-30T06:30:05.414ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
104182025-04-30T06:30:05.415ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
104192025-04-30T06:30:05.417ZINFOtest_image_create (dropshot_internal): request completed latency_us = 22894 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = b77e4dc8-9dfd-4cbc-a616-38a98f86c161 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
104202025-04-30T06:30:05.419ZDEBGtest_image_create (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
104212025-04-30T06:30:05.419ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.321\u{b5}s iteration = 3 status = {"error":"task disabled"}
104222025-04-30T06:30:05.419ZDEBGtest_image_create (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
104232025-04-30T06:30:05.419ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet
104242025-04-30T06:30:05.419ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = switch_port_config_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104252025-04-30T06:30:05.419ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database
104262025-04-30T06:30:05.419ZDEBGtest_image_create (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104272025-04-30T06:30:05.420ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104282025-04-30T06:30:05.421ZDEBGtest_image_create (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
104292025-04-30T06:30:05.421ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory
104302025-04-30T06:30:05.421ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_zone_nat_tracker resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104312025-04-30T06:30:05.421ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database
104322025-04-30T06:30:05.421ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104332025-04-30T06:30:05.422ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104342025-04-30T06:30:05.422ZDEBGtest_image_create (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
104352025-04-30T06:30:05.422ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
104362025-04-30T06:30:05.422ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104372025-04-30T06:30:05.423ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104382025-04-30T06:30:05.423ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
104392025-04-30T06:30:05.423ZDEBGtest_image_create (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
104402025-04-30T06:30:05.424ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet
104412025-04-30T06:30:05.424ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = instance_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104422025-04-30T06:30:05.424ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database
104432025-04-30T06:30:05.424ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104442025-04-30T06:30:05.425ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104452025-04-30T06:30:05.425ZDEBGtest_image_create (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
104462025-04-30T06:30:05.425ZINFOtest_image_create (BackgroundTasks): background instance updater explicitly disabled background_task = instance_updater
104472025-04-30T06:30:05.425ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = instance_updater elapsed = 278.655\u{b5}s iteration = 2 status = {"destroyed_active_vmms":0,"disabled":true,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
104482025-04-30T06:30:05.425ZDEBGtest_image_create (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
104492025-04-30T06:30:05.425ZINFOtest_image_create (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
104502025-04-30T06:30:05.425ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet
104512025-04-30T06:30:05.425ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104522025-04-30T06:30:05.425ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
104532025-04-30T06:30:05.425ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104542025-04-30T06:30:05.426ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104552025-04-30T06:30:05.426ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
104562025-04-30T06:30:05.426ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b77e4dc8-9dfd-4cbc-a616-38a98f86c161", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
104572025-04-30T06:30:05.426ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
104582025-04-30T06:30:05.427ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
104592025-04-30T06:30:05.428ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 25.248626ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
104602025-04-30T06:30:05.430ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
104612025-04-30T06:30:05.430ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
104622025-04-30T06:30:05.432ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
104632025-04-30T06:30:05.433ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 10a543dc-e592-4cc6-bbbb-8c984dbcbd80 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
104642025-04-30T06:30:05.433ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: e0 da 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:61844 req_id = 4adf359f-509f-4223-996d-bb0820b42fd8
104652025-04-30T06:30:05.433ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 57562,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61844 req_id = 4adf359f-509f-4223-996d-bb0820b42fd8
104662025-04-30T06:30:05.433ZDEBGtest_image_create (store): query key key = _dendrite._tcp
104672025-04-30T06:30:05.434ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
104682025-04-30T06:30:05.434ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:61844 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 4adf359f-509f-4223-996d-bb0820b42fd8
104692025-04-30T06:30:05.434ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 10a543dc-e592-4cc6-bbbb-8c984dbcbd80 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
104702025-04-30T06:30:05.434ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 10a543dc-e592-4cc6-bbbb-8c984dbcbd80 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
104712025-04-30T06:30:05.435ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 10a543dc-e592-4cc6-bbbb-8c984dbcbd80 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
104722025-04-30T06:30:05.436ZDEBGtest_image_create (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104732025-04-30T06:30:05.445ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104742025-04-30T06:30:05.445ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database
104752025-04-30T06:30:05.445ZDEBGtest_image_create (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104762025-04-30T06:30:05.445ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104772025-04-30T06:30:05.446ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104782025-04-30T06:30:05.455ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104792025-04-30T06:30:05.455ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database
104802025-04-30T06:30:05.455ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104812025-04-30T06:30:05.456ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104822025-04-30T06:30:05.457ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
104832025-04-30T06:30:05.457ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104842025-04-30T06:30:05.458ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104852025-04-30T06:30:05.459ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104862025-04-30T06:30:05.466ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104872025-04-30T06:30:05.466ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database
104882025-04-30T06:30:05.466ZDEBGtest_image_create (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104892025-04-30T06:30:05.467ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104902025-04-30T06:30:05.467ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104912025-04-30T06:30:05.474ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104922025-04-30T06:30:05.474ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet
104932025-04-30T06:30:05.474ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104942025-04-30T06:30:05.474ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
104952025-04-30T06:30:05.474ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104962025-04-30T06:30:05.475ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104972025-04-30T06:30:05.476ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3470, tv_nsec: 275864354 } })
104982025-04-30T06:30:05.477ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
104992025-04-30T06:30:05.480ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: c0 25 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .%..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:59028 req_id = 064ab73f-2084-4c22-abd7-07ddeb310cb4
105002025-04-30T06:30:05.480ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49189,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59028 req_id = 064ab73f-2084-4c22-abd7-07ddeb310cb4
105012025-04-30T06:30:05.480ZDEBGtest_image_create (store): query key key = _dendrite._tcp
105022025-04-30T06:30:05.481ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
105032025-04-30T06:30:05.481ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:59028 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 064ab73f-2084-4c22-abd7-07ddeb310cb4
105042025-04-30T06:30:05.481ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
105052025-04-30T06:30:05.482ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
105062025-04-30T06:30:05.482ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
105072025-04-30T06:30:05.482ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
105082025-04-30T06:30:05.485ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3470, tv_nsec: 283501711 } })
105092025-04-30T06:30:05.485ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
105102025-04-30T06:30:05.485ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e0f5257-05b8-4ed3-910c-592fc16a1905", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
105112025-04-30T06:30:05.485ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
105122025-04-30T06:30:05.488ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 84 49 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .I..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:62293 req_id = ca0be975-d69f-444a-b520-cfb2ae8af7ae
105132025-04-30T06:30:05.488ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 33865,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62293 req_id = ca0be975-d69f-444a-b520-cfb2ae8af7ae
105142025-04-30T06:30:05.488ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
105152025-04-30T06:30:05.488ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62293 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = ca0be975-d69f-444a-b520-cfb2ae8af7ae
105162025-04-30T06:30:05.489ZINFOtest_image_create (dropshot_internal): request completed latency_us = 56169 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 10a543dc-e592-4cc6-bbbb-8c984dbcbd80 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
105172025-04-30T06:30:05.491ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector
105182025-04-30T06:30:05.553ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector zone_address = ::1
105192025-04-30T06:30:05.553ZDEBGtest_image_create (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[::1]:12225/local/switch-id
105202025-04-30T06:30:05.553ZDEBGtest_image_create (MgsClient): client response background_task = nat_v4_garbage_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
105212025-04-30T06:30:05.553ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = nat_v4_garbage_collector reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
105222025-04-30T06:30:05.555ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = nat_v4_garbage_collector
105232025-04-30T06:30:05.556ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: f7 51 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .Q..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:62235 req_id = c08334f0-ab3a-40eb-96c1-f434a6ec4075
105242025-04-30T06:30:05.556ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63313,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62235 req_id = c08334f0-ab3a-40eb-96c1-f434a6ec4075
105252025-04-30T06:30:05.556ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
105262025-04-30T06:30:05.556ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62235 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = c08334f0-ab3a-40eb-96c1-f434a6ec4075
105272025-04-30T06:30:05.556ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "10a543dc-e592-4cc6-bbbb-8c984dbcbd80", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
105282025-04-30T06:30:05.557ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
105292025-04-30T06:30:05.557ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
105302025-04-30T06:30:05.557ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
105312025-04-30T06:30:05.558ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
105322025-04-30T06:30:05.560ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager
105332025-04-30T06:30:05.646ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager zone_address = ::1
105342025-04-30T06:30:05.647ZDEBGtest_image_create (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[::1]:12225/local/switch-id
105352025-04-30T06:30:05.647ZDEBGtest_image_create (MgsClient): client response background_task = bfd_manager result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
105362025-04-30T06:30:05.647ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = bfd_manager reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
105372025-04-30T06:30:05.652ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = bfd_manager
105382025-04-30T06:30:05.653ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105392025-04-30T06:30:05.653ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105402025-04-30T06:30:05.653ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
105412025-04-30T06:30:05.657ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
105422025-04-30T06:30:05.657ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database
105432025-04-30T06:30:05.657ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105442025-04-30T06:30:05.659ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105452025-04-30T06:30:05.668ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 10 2b 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .+..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:55237 req_id = 2cbcec63-ab53-49e4-840d-9ab05cefcf5b
105462025-04-30T06:30:05.668ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 4139,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55237 req_id = 2cbcec63-ab53-49e4-840d-9ab05cefcf5b
105472025-04-30T06:30:05.670ZDEBGtest_image_create (store): query key key = _dendrite._tcp
105482025-04-30T06:30:05.671ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
105492025-04-30T06:30:05.671ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:55237 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 2cbcec63-ab53-49e4-840d-9ab05cefcf5b
105502025-04-30T06:30:05.674ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
105512025-04-30T06:30:05.674ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
105522025-04-30T06:30:05.675ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3470, tv_nsec: 474860130 } })
105532025-04-30T06:30:05.676ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
105542025-04-30T06:30:05.676ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105552025-04-30T06:30:05.690ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105562025-04-30T06:30:05.690ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
105572025-04-30T06:30:05.690ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105582025-04-30T06:30:05.690ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105592025-04-30T06:30:05.698ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
105602025-04-30T06:30:05.698ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105612025-04-30T06:30:05.698ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 2a 67 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e *g..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51704 req_id = 2b1317fc-d687-4d91-be98-becd80b126fc
105622025-04-30T06:30:05.698ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 10855,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51704 req_id = 2b1317fc-d687-4d91-be98-becd80b126fc
105632025-04-30T06:30:05.699ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
105642025-04-30T06:30:05.699ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51704 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 2b1317fc-d687-4d91-be98-becd80b126fc
105652025-04-30T06:30:05.704ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
105662025-04-30T06:30:05.766ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc zone_address = ::1
105672025-04-30T06:30:05.766ZDEBGtest_image_create (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc uri = http://[::1]:12225/local/switch-id
105682025-04-30T06:30:05.866ZINFOtest_image_create (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
105692025-04-30T06:30:05.866ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:42828/vpc-routes
105702025-04-30T06:30:05.867ZINFOtest_image_create (BackgroundTasks): all instance checks complete background_task = instance_watcher pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105712025-04-30T06:30:05.867ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 443.810433ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105722025-04-30T06:30:05.868ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet
105732025-04-30T06:30:05.868ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105742025-04-30T06:30:05.868ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
105752025-04-30T06:30:05.868ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105762025-04-30T06:30:05.872ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105772025-04-30T06:30:05.874ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:63255 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
105782025-04-30T06:30:05.876ZDEBGtest_image_create (MgsClient): client response background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
105792025-04-30T06:30:05.876ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
105802025-04-30T06:30:05.879ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
105812025-04-30T06:30:05.880ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6c42394-fdbc-4905-b51c-fad162c1ba8b", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
105822025-04-30T06:30:05.881ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
105832025-04-30T06:30:05.881ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
105842025-04-30T06:30:05.884ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105852025-04-30T06:30:05.888ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105862025-04-30T06:30:05.888ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet
105872025-04-30T06:30:05.888ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105882025-04-30T06:30:05.888ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
105892025-04-30T06:30:05.888ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105902025-04-30T06:30:05.889ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105912025-04-30T06:30:05.890ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:63255 req_id = b6766454-6adc-4485-a152-5258f185fe61 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
105922025-04-30T06:30:05.894ZINFOtest_image_create (dropshot): request completed latency_us = 3776 local_addr = [::1]:42828 method = GET remote_addr = [::1]:63255 req_id = b6766454-6adc-4485-a152-5258f185fe61 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
105932025-04-30T06:30:05.896ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:42828/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6766454-6adc-4485-a152-5258f185fe61", "content-length": "2", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
105942025-04-30T06:30:05.896ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database
105952025-04-30T06:30:05.896ZDEBGtest_image_create (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105962025-04-30T06:30:05.897ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105972025-04-30T06:30:05.897ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105982025-04-30T06:30:05.901ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105992025-04-30T06:30:05.901ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database
106002025-04-30T06:30:05.901ZDEBGtest_image_create (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106012025-04-30T06:30:05.902ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106022025-04-30T06:30:05.925ZINFOtest_image_create (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = sim-b6d65341
106032025-04-30T06:30:05.925ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:42828/eip-gateways
106042025-04-30T06:30:05.929ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = PUT remote_addr = [::1]:63255 req_id = efe97774-3785-4790-a54f-a81c3ab0fa2f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
106052025-04-30T06:30:05.929ZINFOtest_image_create (dropshot): request completed latency_us = 317 local_addr = [::1]:42828 method = PUT remote_addr = [::1]:63255 req_id = efe97774-3785-4790-a54f-a81c3ab0fa2f response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
106062025-04-30T06:30:05.930ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database
106072025-04-30T06:30:05.930ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106082025-04-30T06:30:05.931ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106092025-04-30T06:30:05.940ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
106102025-04-30T06:30:05.942ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:42828/eip-gateways", status: 204, headers: {"x-request-id": "efe97774-3785-4790-a54f-a81c3ab0fa2f", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106112025-04-30T06:30:05.946ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 520.338791ms iteration = 2 status = {}
106122025-04-30T06:30:05.946ZTRACtest_image_create (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229, lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
106132025-04-30T06:30:05.946ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = service_zone_nat_tracker resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106142025-04-30T06:30:05.946ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database
106152025-04-30T06:30:05.946ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106162025-04-30T06:30:05.946ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106172025-04-30T06:30:05.951ZDEBGtest_image_create (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106182025-04-30T06:30:05.958ZDEBGtest_image_create (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229, lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
106192025-04-30T06:30:05.958ZERROtest_image_create (BackgroundTasks): ipv6 addresses for service zone nat not implemented background_task = service_zone_nat_tracker
106202025-04-30T06:30:05.958ZERROtest_image_create (BackgroundTasks): generated config for fewer than the minimum allowed number of dns zones background_task = service_zone_nat_tracker
106212025-04-30T06:30:05.958ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 537.742407ms iteration = 2 status = {"error":"generated config for fewer than the minimum allowed number of dns zones"}
106222025-04-30T06:30:05.969ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0e0a9c1-ac53-413b-9cb4-f659085b62e0", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106232025-04-30T06:30:05.969ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
106242025-04-30T06:30:05.987ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a35ae3-f19d-45a9-bfc9-a2bc9ac707ce", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106252025-04-30T06:30:05.987ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
106262025-04-30T06:30:05.991ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
106272025-04-30T06:30:05.991ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106282025-04-30T06:30:05.991ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
106292025-04-30T06:30:05.991ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
106302025-04-30T06:30:05.994ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
106312025-04-30T06:30:05.995ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "65a2a27a-9ab3-4b7b-8f9e-69c379fa780b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106322025-04-30T06:30:05.995ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
106332025-04-30T06:30:05.999ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8968e5ff-7cb1-43d8-b3b1-61fc4f997542", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106342025-04-30T06:30:05.999ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
106352025-04-30T06:30:06.004ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106362025-04-30T06:30:06.013ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
106372025-04-30T06:30:06.013ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
106382025-04-30T06:30:06.013ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
106392025-04-30T06:30:06.014ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
106402025-04-30T06:30:06.086ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:42828/v2p
106412025-04-30T06:30:06.087ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:47004 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
106422025-04-30T06:30:06.088ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:47004 req_id = 66ce12ac-3cb4-4a44-aee2-cfc177fa32a0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
106432025-04-30T06:30:06.088ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "532f76f6-c8e4-4059-bd3c-26f50b314d82", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106442025-04-30T06:30:06.088ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
106452025-04-30T06:30:06.088ZINFOtest_image_create (dropshot): request completed latency_us = 905 local_addr = [::1]:42828 method = GET remote_addr = [::1]:47004 req_id = 66ce12ac-3cb4-4a44-aee2-cfc177fa32a0 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
106462025-04-30T06:30:06.089ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
106472025-04-30T06:30:06.089ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
106482025-04-30T06:30:06.090ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
106492025-04-30T06:30:06.091ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:42828/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "66ce12ac-3cb4-4a44-aee2-cfc177fa32a0", "content-length": "2", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106502025-04-30T06:30:06.091ZINFOtest_image_create (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = sim-b6d65341
106512025-04-30T06:30:06.091ZINFOtest_image_create (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = sim-b6d65341
106522025-04-30T06:30:06.091ZINFOtest_image_create (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [] sled = sim-b6d65341
106532025-04-30T06:30:06.100ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 677.37201ms iteration = 2 status = {}
106542025-04-30T06:30:06.108ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "49e3d6d8-9ac1-4078-a1f9-88d290c7fe06", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106552025-04-30T06:30:06.108ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
106562025-04-30T06:30:06.109ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2c483bf-b60c-43fd-8d85-01df9b2da909", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106572025-04-30T06:30:06.110ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
106582025-04-30T06:30:06.111ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc95332d-18a8-4d2c-9588-9fa817c71f15", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106592025-04-30T06:30:06.111ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
106602025-04-30T06:30:06.113ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab0c3002-c20d-47fa-9c8c-8e370f4898e5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106612025-04-30T06:30:06.113ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
106622025-04-30T06:30:06.115ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e5761fc-3011-42a1-bd4f-a580b8fb534c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106632025-04-30T06:30:06.115ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
106642025-04-30T06:30:06.119ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "01f493ae-f967-4afc-be74-51a42e1f91a5", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106652025-04-30T06:30:06.119ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
106662025-04-30T06:30:06.123ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddb9d2ed-d576-4d81-b6e5-411b0b0d0845", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106672025-04-30T06:30:06.123ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
106682025-04-30T06:30:06.128ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "935514cb-34a8-459c-9a1c-13ec8e0170ec", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106692025-04-30T06:30:06.129ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
106702025-04-30T06:30:06.133ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d00b406b-da34-4cdd-9fce-e5879370cd25", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106712025-04-30T06:30:06.133ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
106722025-04-30T06:30:06.136ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
106732025-04-30T06:30:06.140ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae8619cd-c8b0-4ce2-815c-12840146e06e", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106742025-04-30T06:30:06.151ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
106752025-04-30T06:30:06.156ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9809133c-dc9f-4fe4-8059-695ff9ad39b7", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106762025-04-30T06:30:06.156ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
106772025-04-30T06:30:06.160ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "26a51a01-c022-48f8-8096-96fdf1bb1c63", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106782025-04-30T06:30:06.160ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
106792025-04-30T06:30:06.161ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d5dd5bc-0164-48c4-aa38-ddcf17eaa83c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106802025-04-30T06:30:06.161ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
106812025-04-30T06:30:06.163ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9122557-7e09-42bf-ae87-33d3ec2f50f0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106822025-04-30T06:30:06.164ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
106832025-04-30T06:30:06.166ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "37acbdbd-9661-4534-8d56-322df650049c", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106842025-04-30T06:30:06.166ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
106852025-04-30T06:30:06.168ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6395755b-30eb-4e48-9f14-12ed87a27fed", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106862025-04-30T06:30:06.168ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
106872025-04-30T06:30:06.169ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e78f0300-79e8-417a-b200-a2241520a995", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106882025-04-30T06:30:06.170ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
106892025-04-30T06:30:06.171ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "60b90aee-20f1-4b80-b1ed-35df35dd2ba8", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106902025-04-30T06:30:06.171ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
106912025-04-30T06:30:06.174ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c87ad990-e99f-40c6-9edf-9ced625d235e", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106922025-04-30T06:30:06.174ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
106932025-04-30T06:30:06.177ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "51f01420-e150-4d95-b3c7-363d190b0d48", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106942025-04-30T06:30:06.177ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
106952025-04-30T06:30:06.179ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "65b93074-f9e2-4d8f-91a7-6667c961041f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106962025-04-30T06:30:06.180ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
106972025-04-30T06:30:06.183ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "106ca741-dec2-4ff7-b012-b5d39b2a7f9b", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
106982025-04-30T06:30:06.183ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
106992025-04-30T06:30:06.185ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9800db6-9f1e-4e15-b54b-19bc6df06894", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107002025-04-30T06:30:06.185ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
107012025-04-30T06:30:06.187ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ab03137-1e24-4ab5-b0cb-f57ff1b7afd2", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107022025-04-30T06:30:06.188ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
107032025-04-30T06:30:06.188ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
107042025-04-30T06:30:06.188ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107052025-04-30T06:30:06.188ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
107062025-04-30T06:30:06.188ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
107072025-04-30T06:30:06.190ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
107082025-04-30T06:30:06.191ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d611f5f1-af21-462b-94ad-f715d86d411d", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107092025-04-30T06:30:06.191ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
107102025-04-30T06:30:06.192ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107112025-04-30T06:30:06.200ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
107122025-04-30T06:30:06.200ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
107132025-04-30T06:30:06.200ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
107142025-04-30T06:30:06.200ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
107152025-04-30T06:30:06.201ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2010f63d-40c8-445b-ad92-0c004d6cceb9", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107162025-04-30T06:30:06.201ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
107172025-04-30T06:30:06.203ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
107182025-04-30T06:30:06.203ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
107192025-04-30T06:30:06.204ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
107202025-04-30T06:30:06.204ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f70ce470-38b9-4638-8fe1-6d3d5b73d9d1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107212025-04-30T06:30:06.205ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
107222025-04-30T06:30:06.210ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff966f20-2c72-4d06-8c93-f5e22e4ff3f9", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107232025-04-30T06:30:06.210ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
107242025-04-30T06:30:06.213ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0175fa25-2a94-4fe9-8659-1ec74c3721d5", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107252025-04-30T06:30:06.214ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
107262025-04-30T06:30:06.217ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7792d31e-7b2f-4a01-bd74-7ecce17455c6", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107272025-04-30T06:30:06.217ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
107282025-04-30T06:30:06.226ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a14ade5-5234-430d-84c0-72cc3a7c2bf1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107292025-04-30T06:30:06.226ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
107302025-04-30T06:30:06.231ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a44e6f59-6c19-44d4-b02d-15e1a2824dc1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107312025-04-30T06:30:06.231ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
107322025-04-30T06:30:06.235ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "091d8be8-e351-445f-bcb6-81707339221a", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107332025-04-30T06:30:06.235ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
107342025-04-30T06:30:06.238ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
107352025-04-30T06:30:06.240ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f732d315-5405-4e36-8fec-78e085428f8b", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107362025-04-30T06:30:06.240ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
107372025-04-30T06:30:06.241ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "618702c2-03e3-4416-b3f9-bed05fecf60b", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107382025-04-30T06:30:06.241ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
107392025-04-30T06:30:06.242ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56d07051-cf1b-471b-b928-e88a20164837", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107402025-04-30T06:30:06.243ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
107412025-04-30T06:30:06.244ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0504c54f-a886-4d97-871c-1be2d052a9c3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107422025-04-30T06:30:06.244ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
107432025-04-30T06:30:06.245ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "94bac3b6-f8d1-404d-a99d-0ab1ca619ec9", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107442025-04-30T06:30:06.245ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
107452025-04-30T06:30:06.245ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107462025-04-30T06:30:06.245ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
107472025-04-30T06:30:06.245ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107482025-04-30T06:30:06.246ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107492025-04-30T06:30:06.248ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107502025-04-30T06:30:06.252ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
107512025-04-30T06:30:06.252ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
107522025-04-30T06:30:06.252ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107532025-04-30T06:30:06.253ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
107542025-04-30T06:30:06.253ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107552025-04-30T06:30:06.253ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107562025-04-30T06:30:06.255ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107572025-04-30T06:30:06.260ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
107582025-04-30T06:30:06.260ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
107592025-04-30T06:30:06.260ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107602025-04-30T06:30:06.261ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107612025-04-30T06:30:06.318ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
107622025-04-30T06:30:06.318ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
107632025-04-30T06:30:06.319ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
107642025-04-30T06:30:06.319ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107652025-04-30T06:30:06.319ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
107662025-04-30T06:30:06.319ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
107672025-04-30T06:30:06.320ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
107682025-04-30T06:30:06.320ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:44215 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
107692025-04-30T06:30:06.321ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:44215 req_id = ca83fe08-d87c-4bcf-ba51-8f51c695e368 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
107702025-04-30T06:30:06.321ZINFOtest_image_create (dropshot): request completed latency_us = 461 local_addr = [::1]:42828 method = GET remote_addr = [::1]:44215 req_id = ca83fe08-d87c-4bcf-ba51-8f51c695e368 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
107712025-04-30T06:30:06.322ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca83fe08-d87c-4bcf-ba51-8f51c695e368", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:05 GMT"} })
107722025-04-30T06:30:06.329ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
107732025-04-30T06:30:06.330ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
107742025-04-30T06:30:06.330ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
107752025-04-30T06:30:06.332ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
107762025-04-30T06:30:06.332ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107772025-04-30T06:30:06.332ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
107782025-04-30T06:30:06.332ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107792025-04-30T06:30:06.339ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107802025-04-30T06:30:06.342ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107812025-04-30T06:30:06.352ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
107822025-04-30T06:30:06.352ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
107832025-04-30T06:30:06.352ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
107842025-04-30T06:30:06.352ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
107852025-04-30T06:30:06.357ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
107862025-04-30T06:30:06.357ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
107872025-04-30T06:30:06.357ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
107882025-04-30T06:30:06.358ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107892025-04-30T06:30:06.361ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
107902025-04-30T06:30:06.361ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
107912025-04-30T06:30:06.361ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107922025-04-30T06:30:06.362ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107932025-04-30T06:30:06.429ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
107942025-04-30T06:30:06.429ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
107952025-04-30T06:30:06.431ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
107962025-04-30T06:30:06.432ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
107972025-04-30T06:30:06.432ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
107982025-04-30T06:30:06.432ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
107992025-04-30T06:30:06.473ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
108002025-04-30T06:30:06.519ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108012025-04-30T06:30:06.519ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108022025-04-30T06:30:06.520ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
108032025-04-30T06:30:06.521ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
108042025-04-30T06:30:06.531ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
108052025-04-30T06:30:06.531ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108062025-04-30T06:30:06.532ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
108072025-04-30T06:30:06.532ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
108082025-04-30T06:30:06.534ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
108092025-04-30T06:30:06.546ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
108102025-04-30T06:30:06.546ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
108112025-04-30T06:30:06.551ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108122025-04-30T06:30:06.558ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
108132025-04-30T06:30:06.558ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
108142025-04-30T06:30:06.559ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
108152025-04-30T06:30:06.559ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
108162025-04-30T06:30:06.563ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
108172025-04-30T06:30:06.563ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108182025-04-30T06:30:06.563ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
108192025-04-30T06:30:06.564ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
108202025-04-30T06:30:06.564ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.283181225s iteration = 37 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
108212025-04-30T06:30:06.565ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 38 reason = Signaled
108222025-04-30T06:30:06.565ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
108232025-04-30T06:30:06.565ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108242025-04-30T06:30:06.565ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
108252025-04-30T06:30:06.565ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108262025-04-30T06:30:06.566ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108272025-04-30T06:30:06.570ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
108282025-04-30T06:30:06.570ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
108292025-04-30T06:30:06.571ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
108302025-04-30T06:30:06.572ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108312025-04-30T06:30:06.576ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
108322025-04-30T06:30:06.577ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
108332025-04-30T06:30:06.577ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108342025-04-30T06:30:06.578ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108352025-04-30T06:30:06.584ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
108362025-04-30T06:30:06.585ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
108372025-04-30T06:30:06.586ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 43 73 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 Cs..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:64494 req_id = 616c95de-56ec-435f-9314-d7863f8b9368
108382025-04-30T06:30:06.587ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 17267,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64494 req_id = 616c95de-56ec-435f-9314-d7863f8b9368
108392025-04-30T06:30:06.587ZDEBGtest_image_create (store): query key key = _mgs._tcp
108402025-04-30T06:30:06.587ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
108412025-04-30T06:30:06.587ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:64494 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 616c95de-56ec-435f-9314-d7863f8b9368
108422025-04-30T06:30:06.587ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3471, tv_nsec: 386497428 } })
108432025-04-30T06:30:06.587ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
108442025-04-30T06:30:06.588ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 41 81 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e A...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:58363 req_id = c84050e4-61bb-4586-8fc4-6fd6c9e5eafd
108452025-04-30T06:30:06.588ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 16769,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58363 req_id = c84050e4-61bb-4586-8fc4-6fd6c9e5eafd
108462025-04-30T06:30:06.589ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
108472025-04-30T06:30:06.589ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:58363 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = c84050e4-61bb-4586-8fc4-6fd6c9e5eafd
108482025-04-30T06:30:06.657ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
108492025-04-30T06:30:06.658ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
108502025-04-30T06:30:06.658ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 41 db 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c A............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:57199 req_id = a457a901-c26a-47f6-910e-b70d60b8063f
108512025-04-30T06:30:06.658ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 16859,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57199 req_id = a457a901-c26a-47f6-910e-b70d60b8063f
108522025-04-30T06:30:06.658ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
108532025-04-30T06:30:06.658ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16859, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:57199 req_id = a457a901-c26a-47f6-910e-b70d60b8063f
108542025-04-30T06:30:06.658ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
108552025-04-30T06:30:06.658ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
108562025-04-30T06:30:06.658ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
108572025-04-30T06:30:06.660ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0eb26d4-4b90-4c2e-8586-b5b4a5c1d075", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108582025-04-30T06:30:06.660ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
108592025-04-30T06:30:06.663ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9260ba7-b77c-4354-afb1-13727e09c1a3", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108602025-04-30T06:30:06.663ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
108612025-04-30T06:30:06.666ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "38fa3727-539c-4362-a209-9b587c884ab4", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108622025-04-30T06:30:06.666ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
108632025-04-30T06:30:06.668ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ec71f3f-99ca-4d65-b44e-b2781edddfc5", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108642025-04-30T06:30:06.669ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
108652025-04-30T06:30:06.671ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a38df3c9-4a40-4538-bba6-9aebbd6b3d34", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108662025-04-30T06:30:06.671ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
108672025-04-30T06:30:06.673ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5caa6eb5-92a1-4fb1-9c7e-4fc1208f1375", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108682025-04-30T06:30:06.673ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
108692025-04-30T06:30:06.675ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf95202e-28fe-47bb-bbb6-c6817b386340", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108702025-04-30T06:30:06.675ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
108712025-04-30T06:30:06.677ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b3d72cd-2805-446b-92f7-f4f6cc6ff8e6", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108722025-04-30T06:30:06.677ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
108732025-04-30T06:30:06.682ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a7824b-f5cf-4525-9289-05b41daf77cb", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108742025-04-30T06:30:06.683ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
108752025-04-30T06:30:06.684ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
108762025-04-30T06:30:06.685ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5033ccd7-89c3-469c-a155-b20504d27233", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108772025-04-30T06:30:06.686ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
108782025-04-30T06:30:06.688ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5729cdfe-3cf1-41d0-9ffe-b9cb8afd48e6", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108792025-04-30T06:30:06.689ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
108802025-04-30T06:30:06.693ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "af477b8d-13d0-4e11-a5da-96406c8aa37c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108812025-04-30T06:30:06.693ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
108822025-04-30T06:30:06.697ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af0c2806-f98c-45c0-a2a6-c62188e23d64", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108832025-04-30T06:30:06.698ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
108842025-04-30T06:30:06.712ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "32855afd-113f-475b-9b8b-59aca4388af3", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108852025-04-30T06:30:06.713ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
108862025-04-30T06:30:06.722ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "66d84f53-4c7f-40a0-815d-58faed1df0a3", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108872025-04-30T06:30:06.722ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
108882025-04-30T06:30:06.725ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "798ea380-55c0-4d86-94c4-6de877148aa5", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108892025-04-30T06:30:06.725ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
108902025-04-30T06:30:06.727ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a363a2af-eb3e-4153-b7ca-de3b6012a49a", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108912025-04-30T06:30:06.728ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
108922025-04-30T06:30:06.732ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0b55fe1-1eb8-4f79-bd17-ca4f4078cd32", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
108932025-04-30T06:30:06.733ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
108942025-04-30T06:30:06.735ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
108952025-04-30T06:30:06.735ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108962025-04-30T06:30:06.735ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
108972025-04-30T06:30:06.735ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
108982025-04-30T06:30:06.736ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
108992025-04-30T06:30:06.737ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "142d7b0e-eb10-4e8d-8e9d-77acbee9bfd7", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109002025-04-30T06:30:06.738ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
109012025-04-30T06:30:06.739ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109022025-04-30T06:30:06.748ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
109032025-04-30T06:30:06.748ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
109042025-04-30T06:30:06.748ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
109052025-04-30T06:30:06.748ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
109062025-04-30T06:30:06.749ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "310d3249-e152-45d0-bab7-ec1ea121a62a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109072025-04-30T06:30:06.749ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
109082025-04-30T06:30:06.751ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ae7a719-58f7-4971-a203-6b662036c66e", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109092025-04-30T06:30:06.751ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
109102025-04-30T06:30:06.752ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
109112025-04-30T06:30:06.752ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
109122025-04-30T06:30:06.752ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
109132025-04-30T06:30:06.752ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3971d10a-b083-4585-9971-dc083a418a4e", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109142025-04-30T06:30:06.753ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
109152025-04-30T06:30:06.754ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "105d60fd-3c6a-4fc4-9627-a336480bb91c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109162025-04-30T06:30:06.754ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
109172025-04-30T06:30:06.755ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b708e2d0-db27-486c-a344-d723c940f502", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109182025-04-30T06:30:06.756ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
109192025-04-30T06:30:06.761ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0ac8d40-0654-486c-8862-0b5a1fc9d06b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109202025-04-30T06:30:06.761ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
109212025-04-30T06:30:06.765ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6e96b3b-e3d2-4fdb-8c6d-f571eb3cf773", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109222025-04-30T06:30:06.765ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
109232025-04-30T06:30:06.768ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd3737b4-b2c3-4b1d-9edc-5d5a611a21f8", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109242025-04-30T06:30:06.769ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
109252025-04-30T06:30:06.771ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cf990c4-6910-43f4-aa49-e464ba182ea2", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109262025-04-30T06:30:06.772ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
109272025-04-30T06:30:06.775ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "711218fd-a9b6-4806-9ca6-3a17bc08e655", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109282025-04-30T06:30:06.776ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
109292025-04-30T06:30:06.783ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90e818c0-3b8a-49d1-bc60-9dda92a20f8b", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109302025-04-30T06:30:06.783ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
109312025-04-30T06:30:06.784ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
109322025-04-30T06:30:06.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dc6d481-6782-447d-8554-eb61616a48eb", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109332025-04-30T06:30:06.786ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
109342025-04-30T06:30:06.787ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "15d1207f-fd83-4474-a70d-021f9b10414d", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109352025-04-30T06:30:06.787ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
109362025-04-30T06:30:06.790ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fcc8a94-8df7-4a3e-9f93-ef58227d1e04", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109372025-04-30T06:30:06.790ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
109382025-04-30T06:30:06.791ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "79dd5ff8-5bf8-4d60-a888-85e201a1d8ff", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109392025-04-30T06:30:06.791ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
109402025-04-30T06:30:06.792ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2deb4c6b-0a19-4705-b0ef-a6783ebe6452", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109412025-04-30T06:30:06.793ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
109422025-04-30T06:30:06.795ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "da87c725-61b1-4685-9501-595cca56dd54", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109432025-04-30T06:30:06.795ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
109442025-04-30T06:30:06.798ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "583b24cf-4513-4f7d-ba14-92fe40d45930", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109452025-04-30T06:30:06.798ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
109462025-04-30T06:30:06.800ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa9f6fee-ac6c-4f88-bfa3-28786cd4a970", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109472025-04-30T06:30:06.800ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
109482025-04-30T06:30:06.804ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d59b255a-40f5-41dc-ac8e-4d9de404d2a7", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109492025-04-30T06:30:06.804ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
109502025-04-30T06:30:06.807ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c6b792f-3169-4c52-b10b-6404a1e90dff", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109512025-04-30T06:30:06.808ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
109522025-04-30T06:30:06.811ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7c330bd-df59-49a9-b56c-a8ae4ab18f92", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109532025-04-30T06:30:06.811ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
109542025-04-30T06:30:06.812ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "11df2c48-040c-4722-8de4-5ec5fcca440e", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109552025-04-30T06:30:06.812ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
109562025-04-30T06:30:06.814ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b2361a3-9d7d-4625-aa97-6b5510d4b5c2", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109572025-04-30T06:30:06.814ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
109582025-04-30T06:30:06.815ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "86e13163-ac13-46c6-92d6-0132d45120c4", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109592025-04-30T06:30:06.815ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
109602025-04-30T06:30:06.816ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "79803006-bba2-4a3d-97f1-592fe39c5963", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109612025-04-30T06:30:06.816ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
109622025-04-30T06:30:06.816ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
109632025-04-30T06:30:06.816ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
109642025-04-30T06:30:06.816ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109652025-04-30T06:30:06.817ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109662025-04-30T06:30:06.821ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109672025-04-30T06:30:06.833ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
109682025-04-30T06:30:06.833ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
109692025-04-30T06:30:06.833ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
109702025-04-30T06:30:06.833ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
109712025-04-30T06:30:06.833ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109722025-04-30T06:30:06.834ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109732025-04-30T06:30:06.835ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
109742025-04-30T06:30:06.835ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
109752025-04-30T06:30:06.835ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
109762025-04-30T06:30:06.835ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
109772025-04-30T06:30:06.836ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
109782025-04-30T06:30:06.837ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109792025-04-30T06:30:06.844ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
109802025-04-30T06:30:06.844ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
109812025-04-30T06:30:06.844ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109822025-04-30T06:30:06.844ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109832025-04-30T06:30:06.847ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109842025-04-30T06:30:06.858ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
109852025-04-30T06:30:06.858ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
109862025-04-30T06:30:06.858ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
109872025-04-30T06:30:06.859ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
109882025-04-30T06:30:06.933ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
109892025-04-30T06:30:06.934ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
109902025-04-30T06:30:06.937ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:33400 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
109912025-04-30T06:30:06.937ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:33400 req_id = e25ee177-9e77-4725-9c70-3152fc421ed8 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
109922025-04-30T06:30:06.937ZINFOtest_image_create (dropshot): request completed latency_us = 588 local_addr = [::1]:42828 method = GET remote_addr = [::1]:33400 req_id = e25ee177-9e77-4725-9c70-3152fc421ed8 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
109932025-04-30T06:30:06.937ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
109942025-04-30T06:30:06.940ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
109952025-04-30T06:30:06.941ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
109962025-04-30T06:30:06.942ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "e25ee177-9e77-4725-9c70-3152fc421ed8", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
109972025-04-30T06:30:06.944ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
109982025-04-30T06:30:06.944ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
109992025-04-30T06:30:06.944ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
110002025-04-30T06:30:06.946ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
110012025-04-30T06:30:06.946ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
110022025-04-30T06:30:06.946ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
110032025-04-30T06:30:06.946ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110042025-04-30T06:30:06.948ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110052025-04-30T06:30:06.957ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110062025-04-30T06:30:06.964ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110072025-04-30T06:30:06.965ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
110082025-04-30T06:30:06.965ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110092025-04-30T06:30:06.965ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110102025-04-30T06:30:06.997ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
110112025-04-30T06:30:07.030ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
110122025-04-30T06:30:07.031ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
110132025-04-30T06:30:07.031ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 466.260032ms iteration = 38 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
110142025-04-30T06:30:07.031ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 39 reason = Signaled
110152025-04-30T06:30:07.032ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
110162025-04-30T06:30:07.032ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
110172025-04-30T06:30:07.032ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
110182025-04-30T06:30:07.032ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110192025-04-30T06:30:07.034ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110202025-04-30T06:30:07.037ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110212025-04-30T06:30:07.043ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110222025-04-30T06:30:07.043ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
110232025-04-30T06:30:07.043ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110242025-04-30T06:30:07.044ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110252025-04-30T06:30:07.047ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
110262025-04-30T06:30:07.047ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
110272025-04-30T06:30:07.048ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
110282025-04-30T06:30:07.048ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
110292025-04-30T06:30:07.048ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
110302025-04-30T06:30:07.049ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
110312025-04-30T06:30:07.050ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
110322025-04-30T06:30:07.051ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 1e 11 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:50664 req_id = 95ff7198-ae92-4420-80d7-b9c1e84918a2
110332025-04-30T06:30:07.052ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 7697,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50664 req_id = 95ff7198-ae92-4420-80d7-b9c1e84918a2
110342025-04-30T06:30:07.052ZDEBGtest_image_create (store): query key key = _mgs._tcp
110352025-04-30T06:30:07.052ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
110362025-04-30T06:30:07.052ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:50664 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 95ff7198-ae92-4420-80d7-b9c1e84918a2
110372025-04-30T06:30:07.053ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3471, tv_nsec: 852769143 } })
110382025-04-30T06:30:07.054ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
110392025-04-30T06:30:07.054ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 4f d8 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e O...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51532 req_id = f52c119b-4726-4a7d-af58-c57185cb922c
110402025-04-30T06:30:07.055ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 20440,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51532 req_id = f52c119b-4726-4a7d-af58-c57185cb922c
110412025-04-30T06:30:07.055ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
110422025-04-30T06:30:07.056ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51532 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = f52c119b-4726-4a7d-af58-c57185cb922c
110432025-04-30T06:30:07.056ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110442025-04-30T06:30:07.066ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
110452025-04-30T06:30:07.066ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
110462025-04-30T06:30:07.066ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
110472025-04-30T06:30:07.066ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
110482025-04-30T06:30:07.168ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
110492025-04-30T06:30:07.171ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 83 b2 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:58995 req_id = 6e432f46-2967-4ccb-a0be-0b924a00144e
110502025-04-30T06:30:07.171ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 33714,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58995 req_id = 6e432f46-2967-4ccb-a0be-0b924a00144e
110512025-04-30T06:30:07.178ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
110522025-04-30T06:30:07.179ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33714, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:58995 req_id = 6e432f46-2967-4ccb-a0be-0b924a00144e
110532025-04-30T06:30:07.179ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
110542025-04-30T06:30:07.179ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
110552025-04-30T06:30:07.179ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
110562025-04-30T06:30:07.179ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
110572025-04-30T06:30:07.179ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
110582025-04-30T06:30:07.179ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
110592025-04-30T06:30:07.183ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a55d113-24e0-4103-853f-385145116362", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110602025-04-30T06:30:07.184ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
110612025-04-30T06:30:07.187ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "92caffec-55a6-48d4-a47f-3a5c7e5adeb2", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110622025-04-30T06:30:07.187ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
110632025-04-30T06:30:07.200ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "37b30681-2337-4882-886b-7f1a9bef5838", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110642025-04-30T06:30:07.200ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
110652025-04-30T06:30:07.204ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "db868e3f-b6a9-46a3-996d-e0ec5215cb30", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110662025-04-30T06:30:07.204ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
110672025-04-30T06:30:07.209ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0d2997c-4d1a-41ca-a94b-c21f8f2b8db4", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110682025-04-30T06:30:07.211ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
110692025-04-30T06:30:07.220ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d4a3173-5cc7-4fc8-98d8-1f8592e79f1d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110702025-04-30T06:30:07.220ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
110712025-04-30T06:30:07.226ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d956cdd-04c7-4d86-aec2-77dbfaf1b6b2", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110722025-04-30T06:30:07.226ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
110732025-04-30T06:30:07.228ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "24c00e89-323b-46a2-8d5c-666f900a4e3d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110742025-04-30T06:30:07.228ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
110752025-04-30T06:30:07.229ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f532625f-6a0e-4a3a-8c1d-094f3e2242ff", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110762025-04-30T06:30:07.229ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
110772025-04-30T06:30:07.230ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "caa620ca-c52b-4515-8cd9-859b28b329b9", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110782025-04-30T06:30:07.230ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
110792025-04-30T06:30:07.231ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "21e93768-e31a-45d3-8bd1-ef44d4edba89", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110802025-04-30T06:30:07.232ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
110812025-04-30T06:30:07.234ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
110822025-04-30T06:30:07.237ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f9448c-f9ed-430c-bee2-b35a8871bc56", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110832025-04-30T06:30:07.237ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
110842025-04-30T06:30:07.239ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f510f155-6dab-4777-b6a2-2da8dd15c65a", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110852025-04-30T06:30:07.239ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
110862025-04-30T06:30:07.245ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbe7d4d3-8558-4fbb-b775-68e5ac77c9f2", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110872025-04-30T06:30:07.245ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
110882025-04-30T06:30:07.248ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1e93783-892e-4ffc-8925-98eae73d6243", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110892025-04-30T06:30:07.248ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
110902025-04-30T06:30:07.250ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e8f44d6-6243-418c-9500-706e009e8726", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110912025-04-30T06:30:07.250ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
110922025-04-30T06:30:07.252ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dc1ece5-7fa4-4b3f-a11f-1a6c45ffbc7d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110932025-04-30T06:30:07.253ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
110942025-04-30T06:30:07.255ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "93566c00-c6f3-4248-9fdc-81e5ad84ecd5", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110952025-04-30T06:30:07.255ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
110962025-04-30T06:30:07.257ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7b906af-b8b4-4738-aeb3-09521895bc15", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110972025-04-30T06:30:07.258ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
110982025-04-30T06:30:07.260ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4472e126-12d9-417c-9d5c-fc0042243220", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
110992025-04-30T06:30:07.260ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
111002025-04-30T06:30:07.261ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b2fcc06-4e1e-4dc1-b767-d7b29eeb7557", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111012025-04-30T06:30:07.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
111022025-04-30T06:30:07.262ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b120613-557c-481c-99e6-92bf9a507aba", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111032025-04-30T06:30:07.262ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
111042025-04-30T06:30:07.263ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ae8c686-64f0-4dcc-a063-e3c26f1c1767", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111052025-04-30T06:30:07.263ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
111062025-04-30T06:30:07.265ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "733253fc-306f-4bbf-8aea-a7359927c89d", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111072025-04-30T06:30:07.265ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
111082025-04-30T06:30:07.268ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c93117-e429-4239-a3f2-30156149428b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111092025-04-30T06:30:07.268ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
111102025-04-30T06:30:07.271ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e46dcdeb-2a1f-408b-8932-70ad6604a66e", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111112025-04-30T06:30:07.271ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
111122025-04-30T06:30:07.274ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9abae1ab-8848-44b2-8b05-3a4bb89f96c6", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111132025-04-30T06:30:07.274ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
111142025-04-30T06:30:07.278ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e85fb3c5-ace0-493c-9d29-89e49458a2d6", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111152025-04-30T06:30:07.278ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
111162025-04-30T06:30:07.280ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa034112-f468-4ff3-9619-7409ff4eb059", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111172025-04-30T06:30:07.280ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
111182025-04-30T06:30:07.282ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bbd7c10-1024-4673-8198-ee46edbbd180", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111192025-04-30T06:30:07.282ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
111202025-04-30T06:30:07.283ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b8c1a1d-1908-4992-b77b-ae9d9c011839", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111212025-04-30T06:30:07.283ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
111222025-04-30T06:30:07.284ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fe8e2a0-5fc8-4a45-9c7f-0010e8b284bb", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111232025-04-30T06:30:07.284ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
111242025-04-30T06:30:07.285ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
111252025-04-30T06:30:07.286ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
111262025-04-30T06:30:07.286ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
111272025-04-30T06:30:07.286ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
111282025-04-30T06:30:07.287ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
111292025-04-30T06:30:07.287ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "316c494e-63aa-4d3b-83a6-22c60f2b9e3d", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111302025-04-30T06:30:07.287ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
111312025-04-30T06:30:07.289ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2f85a84-ae3f-400e-93c7-5fe0a72b9ef4", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111322025-04-30T06:30:07.289ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
111332025-04-30T06:30:07.290ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111342025-04-30T06:30:07.295ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
111352025-04-30T06:30:07.295ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
111362025-04-30T06:30:07.295ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
111372025-04-30T06:30:07.295ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
111382025-04-30T06:30:07.298ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "902e6987-7246-4dea-b5aa-5aa7b8920d51", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111392025-04-30T06:30:07.298ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
111402025-04-30T06:30:07.298ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
111412025-04-30T06:30:07.298ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
111422025-04-30T06:30:07.298ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
111432025-04-30T06:30:07.303ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc0a0132-002e-4448-80d7-97b9c28191eb", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111442025-04-30T06:30:07.303ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
111452025-04-30T06:30:07.308ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
111462025-04-30T06:30:07.308ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
111472025-04-30T06:30:07.308ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 07a90d4e-49b8-4537-bb1d-bec86b669b19 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
111482025-04-30T06:30:07.309ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 07a90d4e-49b8-4537-bb1d-bec86b669b19 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
111492025-04-30T06:30:07.309ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 07a90d4e-49b8-4537-bb1d-bec86b669b19 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
111502025-04-30T06:30:07.309ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 07a90d4e-49b8-4537-bb1d-bec86b669b19 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
111512025-04-30T06:30:07.312ZINFOtest_image_create (dropshot_internal): request completed latency_us = 3702 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 07a90d4e-49b8-4537-bb1d-bec86b669b19 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
111522025-04-30T06:30:07.315ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "07a90d4e-49b8-4537-bb1d-bec86b669b19", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111532025-04-30T06:30:07.315ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
111542025-04-30T06:30:07.317ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 923dfe6d-be21-45cf-b4d9-e685d054a47b uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
111552025-04-30T06:30:07.317ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f4153c5-1e10-4218-a38f-1cec5c0c629d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111562025-04-30T06:30:07.317ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
111572025-04-30T06:30:07.318ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 923dfe6d-be21-45cf-b4d9-e685d054a47b resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
111582025-04-30T06:30:07.318ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 923dfe6d-be21-45cf-b4d9-e685d054a47b roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
111592025-04-30T06:30:07.320ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 923dfe6d-be21-45cf-b4d9-e685d054a47b resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
111602025-04-30T06:30:07.322ZINFOtest_image_create (dropshot_internal): request completed latency_us = 5366 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 923dfe6d-be21-45cf-b4d9-e685d054a47b response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
111612025-04-30T06:30:07.322ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "923dfe6d-be21-45cf-b4d9-e685d054a47b", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111622025-04-30T06:30:07.322ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111632025-04-30T06:30:07.322ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
111642025-04-30T06:30:07.322ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
111652025-04-30T06:30:07.324ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bdc7b49-7106-4f79-9769-63d28cb98bf1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111662025-04-30T06:30:07.324ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
111672025-04-30T06:30:07.328ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0237391-b320-413b-aae7-2e90b7709a9a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111682025-04-30T06:30:07.328ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
111692025-04-30T06:30:07.332ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fea5cdde-fe80-401c-bec0-9346ac66930c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111702025-04-30T06:30:07.332ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
111712025-04-30T06:30:07.334ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7afb341-8b9f-4729-8bf2-8614ad3366ee", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111722025-04-30T06:30:07.334ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
111732025-04-30T06:30:07.337ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b02dfef-7326-488b-989d-228b938fef21", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111742025-04-30T06:30:07.337ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
111752025-04-30T06:30:07.338ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
111762025-04-30T06:30:07.339ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "258ea539-0233-4b8f-a01f-1f85425af273", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111772025-04-30T06:30:07.339ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
111782025-04-30T06:30:07.342ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111792025-04-30T06:30:07.342ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "08dde1d8-f966-4af3-9544-7b0f9a95088d", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111802025-04-30T06:30:07.342ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
111812025-04-30T06:30:07.342ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111822025-04-30T06:30:07.342ZTRACtest_image_create (dropshot): incoming request local_addr = 127.0.0.1:36387 method = GET remote_addr = 127.0.0.1:52624 req_id = 65644801-c5de-4ea1-aa3b-4f9410333606 uri = /95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111832025-04-30T06:30:07.346ZINFOtest_image_create (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5007 local_addr = 127.0.0.1:36387 method = GET remote_addr = 127.0.0.1:52624 req_id = 65644801-c5de-4ea1-aa3b-4f9410333606 response_code = 200 uri = /95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111842025-04-30T06:30:07.348ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111852025-04-30T06:30:07.356ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111862025-04-30T06:30:07.356ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111872025-04-30T06:30:07.356ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
111882025-04-30T06:30:07.357ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5232006-6245-4a35-a7de-1b050efeef98", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:06 GMT"} })
111892025-04-30T06:30:07.357ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
111902025-04-30T06:30:07.357ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
111912025-04-30T06:30:07.357ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
111922025-04-30T06:30:07.357ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111932025-04-30T06:30:07.358ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111942025-04-30T06:30:07.365ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111952025-04-30T06:30:07.370ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111962025-04-30T06:30:07.370ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
111972025-04-30T06:30:07.370ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
111982025-04-30T06:30:07.370ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
111992025-04-30T06:30:07.371ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112002025-04-30T06:30:07.371ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112012025-04-30T06:30:07.373ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112022025-04-30T06:30:07.382ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
112032025-04-30T06:30:07.382ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
112042025-04-30T06:30:07.382ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112052025-04-30T06:30:07.383ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112062025-04-30T06:30:07.389ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
112072025-04-30T06:30:07.389ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
112082025-04-30T06:30:07.389ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
112092025-04-30T06:30:07.389ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
112102025-04-30T06:30:07.390ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
112112025-04-30T06:30:07.509ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
112122025-04-30T06:30:07.509ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
112132025-04-30T06:30:07.511ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:57643 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
112142025-04-30T06:30:07.512ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
112152025-04-30T06:30:07.513ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
112162025-04-30T06:30:07.519ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:57643 req_id = 022a8bd8-7485-4a0d-b7e4-7d151f0c7585 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
112172025-04-30T06:30:07.535ZDEBGtest_image_create (results-sink): inserting 5 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112182025-04-30T06:30:07.535ZDEBGtest_image_create (results-sink-cluster): inserting 5 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112192025-04-30T06:30:07.539ZINFOtest_image_create (dropshot): request completed latency_us = 19525 local_addr = [::1]:42828 method = GET remote_addr = [::1]:57643 req_id = 022a8bd8-7485-4a0d-b7e4-7d151f0c7585 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
112202025-04-30T06:30:07.541ZDEBGtest_image_create (clickhouse-client): unrolling 5 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
112212025-04-30T06:30:07.546ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_string FORMAT Native
112222025-04-30T06:30:07.547ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112232025-04-30T06:30:07.553ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
112242025-04-30T06:30:07.553ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
112252025-04-30T06:30:07.553ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
112262025-04-30T06:30:07.553ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
112272025-04-30T06:30:07.555ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
112282025-04-30T06:30:07.556ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
112292025-04-30T06:30:07.556ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
112302025-04-30T06:30:07.556ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
112312025-04-30T06:30:07.556ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "022a8bd8-7485-4a0d-b7e4-7d151f0c7585", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
112322025-04-30T06:30:07.559ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
112332025-04-30T06:30:07.559ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
112342025-04-30T06:30:07.559ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
112352025-04-30T06:30:07.563ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
112362025-04-30T06:30:07.563ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
112372025-04-30T06:30:07.563ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
112382025-04-30T06:30:07.563ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112392025-04-30T06:30:07.570ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112402025-04-30T06:30:07.570ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
112412025-04-30T06:30:07.576ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 10 table_name = fields_string
112422025-04-30T06:30:07.577ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 5 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
112432025-04-30T06:30:07.585ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
112442025-04-30T06:30:07.585ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
112452025-04-30T06:30:07.586ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
112462025-04-30T06:30:07.588ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: ec 6e 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .n..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:63539 req_id = af553436-550e-45c9-917d-76ffc0131571
112472025-04-30T06:30:07.588ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60526,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63539 req_id = af553436-550e-45c9-917d-76ffc0131571
112482025-04-30T06:30:07.589ZDEBGtest_image_create (store): query key key = _dendrite._tcp
112492025-04-30T06:30:07.589ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
112502025-04-30T06:30:07.590ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63539 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = af553436-550e-45c9-917d-76ffc0131571
112512025-04-30T06:30:07.590ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112522025-04-30T06:30:07.597ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
112532025-04-30T06:30:07.597ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
112542025-04-30T06:30:07.598ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112552025-04-30T06:30:07.598ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112562025-04-30T06:30:07.599ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3472, tv_nsec: 398643994 } })
112572025-04-30T06:30:07.599ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
112582025-04-30T06:30:07.600ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 5 table_name = fields_u16
112592025-04-30T06:30:07.600ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 5 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
112602025-04-30T06:30:07.609ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 50 c9 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e P...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56653 req_id = 1f2c73b6-01a5-4638-ad8e-b0ab8b879ee2
112612025-04-30T06:30:07.609ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 20681,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56653 req_id = 1f2c73b6-01a5-4638-ad8e-b0ab8b879ee2
112622025-04-30T06:30:07.618ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
112632025-04-30T06:30:07.618ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56653 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 1f2c73b6-01a5-4638-ad8e-b0ab8b879ee2
112642025-04-30T06:30:07.619ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector
112652025-04-30T06:30:07.723ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector zone_address = ::1
112662025-04-30T06:30:07.723ZDEBGtest_image_create (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[::1]:12225/local/switch-id
112672025-04-30T06:30:07.723ZDEBGtest_image_create (MgsClient): client response background_task = nat_v4_garbage_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
112682025-04-30T06:30:07.723ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = nat_v4_garbage_collector reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
112692025-04-30T06:30:07.727ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = nat_v4_garbage_collector
112702025-04-30T06:30:07.727ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 5 table_name = fields_uuid
112712025-04-30T06:30:07.727ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 19 n_rows = 5 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
112722025-04-30T06:30:07.728ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
112732025-04-30T06:30:07.730ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
112742025-04-30T06:30:07.736ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 61 e0 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 a............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:63411 req_id = 1ef5f874-3fe1-4c0f-b71f-1f8eb7fee076
112752025-04-30T06:30:07.736ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25056,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63411 req_id = 1ef5f874-3fe1-4c0f-b71f-1f8eb7fee076
112762025-04-30T06:30:07.737ZDEBGtest_image_create (store): query key key = _dendrite._tcp
112772025-04-30T06:30:07.737ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
112782025-04-30T06:30:07.738ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63411 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 1ef5f874-3fe1-4c0f-b71f-1f8eb7fee076
112792025-04-30T06:30:07.741ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3472, tv_nsec: 540311276 } })
112802025-04-30T06:30:07.741ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
112812025-04-30T06:30:07.741ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 5 table_name = measurements_histogramu64
112822025-04-30T06:30:07.741ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112832025-04-30T06:30:07.758ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 13 6d 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .m..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:53823 req_id = cd11d103-01df-4675-b080-f7deb23f6ccb
112842025-04-30T06:30:07.758ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 4973,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:53823 req_id = cd11d103-01df-4675-b080-f7deb23f6ccb
112852025-04-30T06:30:07.758ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
112862025-04-30T06:30:07.758ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:53823 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = cd11d103-01df-4675-b080-f7deb23f6ccb
112872025-04-30T06:30:07.764ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager
112882025-04-30T06:30:07.841ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager zone_address = ::1
112892025-04-30T06:30:07.841ZDEBGtest_image_create (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[::1]:12225/local/switch-id
112902025-04-30T06:30:07.841ZDEBGtest_image_create (MgsClient): client response background_task = bfd_manager result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
112912025-04-30T06:30:07.841ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = bfd_manager reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
112922025-04-30T06:30:07.844ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = bfd_manager
112932025-04-30T06:30:07.874ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
112942025-04-30T06:30:07.874ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
112952025-04-30T06:30:07.874ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 842.664604ms iteration = 39 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
112962025-04-30T06:30:07.874ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 40 reason = Signaled
112972025-04-30T06:30:07.874ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
112982025-04-30T06:30:07.874ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
112992025-04-30T06:30:07.874ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
113002025-04-30T06:30:07.874ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
113012025-04-30T06:30:07.876ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
113022025-04-30T06:30:07.886ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
113032025-04-30T06:30:07.892ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113042025-04-30T06:30:07.897ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
113052025-04-30T06:30:07.897ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
113062025-04-30T06:30:07.897ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
113072025-04-30T06:30:07.897ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
113082025-04-30T06:30:07.898ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
113092025-04-30T06:30:07.898ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 44 f6 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 D............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:61751 req_id = 13d3bbf3-6182-41b5-a01a-f6f8663d9794
113102025-04-30T06:30:07.898ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 17654,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61751 req_id = 13d3bbf3-6182-41b5-a01a-f6f8663d9794
113112025-04-30T06:30:07.899ZDEBGtest_image_create (store): query key key = _dendrite._tcp
113122025-04-30T06:30:07.899ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
113132025-04-30T06:30:07.899ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:61751 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 13d3bbf3-6182-41b5-a01a-f6f8663d9794
113142025-04-30T06:30:07.900ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3472, tv_nsec: 699684808 } })
113152025-04-30T06:30:07.900ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
113162025-04-30T06:30:07.901ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: f3 09 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:55258 req_id = ad3436a8-216a-4d07-b4d3-34c13b2ebdc9
113172025-04-30T06:30:07.901ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62217,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55258 req_id = ad3436a8-216a-4d07-b4d3-34c13b2ebdc9
113182025-04-30T06:30:07.901ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
113192025-04-30T06:30:07.901ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:55258 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = ad3436a8-216a-4d07-b4d3-34c13b2ebdc9
113202025-04-30T06:30:07.901ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
113212025-04-30T06:30:07.967ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc zone_address = ::1
113222025-04-30T06:30:07.968ZDEBGtest_image_create (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc uri = http://[::1]:12225/local/switch-id
113232025-04-30T06:30:07.968ZDEBGtest_image_create (MgsClient): client response background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
113242025-04-30T06:30:07.968ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
113252025-04-30T06:30:07.969ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
113262025-04-30T06:30:07.969ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
113272025-04-30T06:30:07.969ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
113282025-04-30T06:30:07.970ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
113292025-04-30T06:30:07.970ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
113302025-04-30T06:30:07.970ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
113312025-04-30T06:30:07.970ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
113322025-04-30T06:30:07.972ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
113332025-04-30T06:30:07.974ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: fa 7c 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .|..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:55271 req_id = 99e52d19-4a95-4b1d-940d-ce4d18a9fdcb
113342025-04-30T06:30:07.976ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64124,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55271 req_id = 99e52d19-4a95-4b1d-940d-ce4d18a9fdcb
113352025-04-30T06:30:07.976ZDEBGtest_image_create (store): query key key = _mgs._tcp
113362025-04-30T06:30:07.976ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
113372025-04-30T06:30:07.976ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:55271 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 99e52d19-4a95-4b1d-940d-ce4d18a9fdcb
113382025-04-30T06:30:07.978ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3472, tv_nsec: 777214290 } })
113392025-04-30T06:30:07.978ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
113402025-04-30T06:30:07.978ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: e7 7c 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .|..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51251 req_id = ad80e721-da2d-48e3-af87-2c23a46cf424
113412025-04-30T06:30:07.978ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 59260,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51251 req_id = ad80e721-da2d-48e3-af87-2c23a46cf424
113422025-04-30T06:30:07.979ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
113432025-04-30T06:30:07.979ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51251 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = ad80e721-da2d-48e3-af87-2c23a46cf424
113442025-04-30T06:30:08.049ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
113452025-04-30T06:30:08.050ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113462025-04-30T06:30:08.057ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
113472025-04-30T06:30:08.058ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
113482025-04-30T06:30:08.058ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
113492025-04-30T06:30:08.058ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
113502025-04-30T06:30:08.063ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 47 4d 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c GM..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:56726 req_id = 8ce7daaa-68ae-40d6-adbc-618cdcee46c5
113512025-04-30T06:30:08.063ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 18253,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56726 req_id = 8ce7daaa-68ae-40d6-adbc-618cdcee46c5
113522025-04-30T06:30:08.063ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
113532025-04-30T06:30:08.064ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18253, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:56726 req_id = 8ce7daaa-68ae-40d6-adbc-618cdcee46c5
113542025-04-30T06:30:08.064ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
113552025-04-30T06:30:08.064ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
113562025-04-30T06:30:08.065ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
113572025-04-30T06:30:08.066ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dd12234-bc47-4c13-9cf7-13756e16703c", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113582025-04-30T06:30:08.067ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
113592025-04-30T06:30:08.068ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
113602025-04-30T06:30:08.068ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
113612025-04-30T06:30:08.069ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
113622025-04-30T06:30:08.072ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "16707fc9-74e1-4225-899c-2b04c5529a07", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113632025-04-30T06:30:08.072ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
113642025-04-30T06:30:08.074ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec308cae-7244-4c68-a25e-a6dc03d359a4", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113652025-04-30T06:30:08.074ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
113662025-04-30T06:30:08.078ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fff1b97-5771-4b7e-ae35-8972ace61391", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113672025-04-30T06:30:08.078ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
113682025-04-30T06:30:08.081ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc3382a-32ab-44af-8716-63fa87d9741e", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113692025-04-30T06:30:08.081ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
113702025-04-30T06:30:08.088ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dc2808e-a31a-458f-bb7b-5bbe5074112c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113712025-04-30T06:30:08.088ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
113722025-04-30T06:30:08.094ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "45b96953-acf2-4427-889e-47e9fb4296b2", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113732025-04-30T06:30:08.094ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
113742025-04-30T06:30:08.110ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "acd0aeec-7af5-4dc9-90d3-5cd084d28648", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113752025-04-30T06:30:08.110ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
113762025-04-30T06:30:08.112ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "816ad508-e745-45a0-84fd-cf1fb05b123d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113772025-04-30T06:30:08.112ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
113782025-04-30T06:30:08.113ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbff7e81-039f-4e22-b96b-fb78ade6e42b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113792025-04-30T06:30:08.114ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
113802025-04-30T06:30:08.115ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56f6a83f-d13e-4a95-8d37-a96cb57096e0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113812025-04-30T06:30:08.115ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
113822025-04-30T06:30:08.118ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "856e540b-7f48-4e42-bb93-9f622730e9a1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113832025-04-30T06:30:08.118ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
113842025-04-30T06:30:08.121ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "36caccf4-3d39-4eb9-a0ce-5bcbc84725e6", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113852025-04-30T06:30:08.121ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
113862025-04-30T06:30:08.128ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "57533760-e9c6-4d19-95fc-99ef7a1cbe06", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113872025-04-30T06:30:08.128ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
113882025-04-30T06:30:08.132ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3403954d-7583-4d8f-811d-d4da16fa3563", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113892025-04-30T06:30:08.132ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
113902025-04-30T06:30:08.139ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "043dc8ea-8de8-4996-92ee-9888c77b5c16", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113912025-04-30T06:30:08.139ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
113922025-04-30T06:30:08.142ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ab07fc6-621f-468d-9398-a1a5790f96d5", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113932025-04-30T06:30:08.142ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
113942025-04-30T06:30:08.149ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
113952025-04-30T06:30:08.153ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba52a2c6-2c98-4daa-b95a-6cd45be3d9da", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113962025-04-30T06:30:08.153ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
113972025-04-30T06:30:08.168ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "59c22b25-9b3b-4b6c-af3e-d9a40351b4e6", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
113982025-04-30T06:30:08.169ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
113992025-04-30T06:30:08.170ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb157e29-2961-4122-ad80-276205004378", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114002025-04-30T06:30:08.170ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
114012025-04-30T06:30:08.173ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4442344-2c09-479e-a562-a7e871f59b2f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114022025-04-30T06:30:08.173ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
114032025-04-30T06:30:08.176ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "03337553-4975-462d-a60a-2fc36a67c8be", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114042025-04-30T06:30:08.176ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
114052025-04-30T06:30:08.178ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "43b0975e-7dc3-400c-b5d7-c29979089a29", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114062025-04-30T06:30:08.179ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
114072025-04-30T06:30:08.185ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6d7a791-7812-45f2-9fc6-55a89e4eb18e", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114082025-04-30T06:30:08.185ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
114092025-04-30T06:30:08.187ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2df6aaac-186b-45c2-a00f-e5f3532454a7", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114102025-04-30T06:30:08.188ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
114112025-04-30T06:30:08.191ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "391e7df2-7de1-4956-af95-811820df7ada", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114122025-04-30T06:30:08.192ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
114132025-04-30T06:30:08.203ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
114142025-04-30T06:30:08.203ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114152025-04-30T06:30:08.203ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
114162025-04-30T06:30:08.203ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
114172025-04-30T06:30:08.205ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
114182025-04-30T06:30:08.206ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "09adeb88-adb3-4535-9db1-5b2e86770712", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114192025-04-30T06:30:08.207ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
114202025-04-30T06:30:08.209ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f8db6d5-3175-443d-8d91-2a7c902fbf47", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114212025-04-30T06:30:08.209ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
114222025-04-30T06:30:08.211ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114232025-04-30T06:30:08.217ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
114242025-04-30T06:30:08.217ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
114252025-04-30T06:30:08.217ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
114262025-04-30T06:30:08.217ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
114272025-04-30T06:30:08.218ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d346a44-1638-4715-bd71-0b0185386952", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114282025-04-30T06:30:08.219ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
114292025-04-30T06:30:08.226ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
114302025-04-30T06:30:08.226ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
114312025-04-30T06:30:08.228ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
114322025-04-30T06:30:08.230ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "de2f29be-4ca7-414b-826a-115850e224d5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114332025-04-30T06:30:08.230ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
114342025-04-30T06:30:08.232ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5093df-b531-4fdb-8311-1a6e5f608dd4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114352025-04-30T06:30:08.232ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
114362025-04-30T06:30:08.234ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7c69321-83e3-4525-95d8-8a0b24dd6108", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114372025-04-30T06:30:08.234ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
114382025-04-30T06:30:08.236ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e128188-7e50-4647-bc43-d04cb5f36875", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114392025-04-30T06:30:08.236ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
114402025-04-30T06:30:08.238ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf368964-d77a-4d0f-b1ce-8d5886d0d967", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114412025-04-30T06:30:08.238ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
114422025-04-30T06:30:08.242ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d29ff91b-fbee-40ee-a704-bab3f5cb6abb", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114432025-04-30T06:30:08.243ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
114442025-04-30T06:30:08.247ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb49e2f3-a469-4fef-a59a-96344ad4f818", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114452025-04-30T06:30:08.247ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
114462025-04-30T06:30:08.249ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2504cac-7e03-4754-83f8-ff5eb85afce9", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114472025-04-30T06:30:08.249ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
114482025-04-30T06:30:08.254ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bf1c0d4-4641-41cb-b8ff-c4965c20999f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114492025-04-30T06:30:08.254ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
114502025-04-30T06:30:08.258ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5fc1649-667a-4e72-812a-9e57de9a42a6", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114512025-04-30T06:30:08.258ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
114522025-04-30T06:30:08.261ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "169bada6-3dc9-416a-b16f-f84f83e61e55", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114532025-04-30T06:30:08.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
114542025-04-30T06:30:08.270ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff300060-b730-40f7-bf96-84a375157212", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114552025-04-30T06:30:08.271ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
114562025-04-30T06:30:08.273ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f41950f3-94e9-4406-8c8f-5fa6ce89e637", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114572025-04-30T06:30:08.275ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
114582025-04-30T06:30:08.275ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
114592025-04-30T06:30:08.281ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3686a73a-1583-42c0-a8c7-24740d489540", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114602025-04-30T06:30:08.283ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
114612025-04-30T06:30:08.286ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "90df6790-f44f-4251-bf73-eefe6f154826", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114622025-04-30T06:30:08.287ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
114632025-04-30T06:30:08.290ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ef0641f-e579-4c12-ae9f-4d32fe48bb62", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
114642025-04-30T06:30:08.290ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
114652025-04-30T06:30:08.290ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114662025-04-30T06:30:08.290ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
114672025-04-30T06:30:08.290ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114682025-04-30T06:30:08.291ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114692025-04-30T06:30:08.294ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114702025-04-30T06:30:08.319ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
114712025-04-30T06:30:08.319ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
114722025-04-30T06:30:08.319ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114732025-04-30T06:30:08.319ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
114742025-04-30T06:30:08.319ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114752025-04-30T06:30:08.321ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114762025-04-30T06:30:08.324ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114772025-04-30T06:30:08.329ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
114782025-04-30T06:30:08.329ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
114792025-04-30T06:30:08.329ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114802025-04-30T06:30:08.329ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114812025-04-30T06:30:08.330ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
114822025-04-30T06:30:08.330ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114832025-04-30T06:30:08.330ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
114842025-04-30T06:30:08.330ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
114852025-04-30T06:30:08.330ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
114862025-04-30T06:30:08.443ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
114872025-04-30T06:30:08.444ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
114882025-04-30T06:30:08.444ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114892025-04-30T06:30:08.463ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
114902025-04-30T06:30:08.463ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
114912025-04-30T06:30:08.463ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
114922025-04-30T06:30:08.463ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
114932025-04-30T06:30:08.464ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:58145 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
114942025-04-30T06:30:08.464ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
114952025-04-30T06:30:08.464ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
114962025-04-30T06:30:08.465ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:58145 req_id = 65f40bbb-f955-4465-bef1-f5f1da8b4a86 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
114972025-04-30T06:30:08.469ZINFOtest_image_create (dropshot): request completed latency_us = 3510 local_addr = [::1]:42828 method = GET remote_addr = [::1]:58145 req_id = 65f40bbb-f955-4465-bef1-f5f1da8b4a86 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
114982025-04-30T06:30:08.469ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
114992025-04-30T06:30:08.471ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
115002025-04-30T06:30:08.471ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
115012025-04-30T06:30:08.471ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
115022025-04-30T06:30:08.471ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "65f40bbb-f955-4465-bef1-f5f1da8b4a86", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:07 GMT"} })
115032025-04-30T06:30:08.476ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
115042025-04-30T06:30:08.476ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
115052025-04-30T06:30:08.476ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
115062025-04-30T06:30:08.480ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
115072025-04-30T06:30:08.480ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
115082025-04-30T06:30:08.480ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
115092025-04-30T06:30:08.480ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115102025-04-30T06:30:08.481ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115112025-04-30T06:30:08.483ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
115122025-04-30T06:30:08.483ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
115132025-04-30T06:30:08.485ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
115142025-04-30T06:30:08.492ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115152025-04-30T06:30:08.498ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
115162025-04-30T06:30:08.498ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
115172025-04-30T06:30:08.498ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115182025-04-30T06:30:08.499ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115192025-04-30T06:30:08.515ZDEBGtest_image_create (results-sink-cluster): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115202025-04-30T06:30:08.515ZDEBGtest_image_create (results-sink): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115212025-04-30T06:30:08.515ZDEBGtest_image_create (clickhouse-client): unrolling 2 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
115222025-04-30T06:30:08.517ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
115232025-04-30T06:30:08.528ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
115242025-04-30T06:30:08.528ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
115252025-04-30T06:30:08.533ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = measurements_i64
115262025-04-30T06:30:08.533ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115272025-04-30T06:30:08.562ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
115282025-04-30T06:30:08.562ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
115292025-04-30T06:30:08.563ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
115302025-04-30T06:30:08.563ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 688.476715ms iteration = 40 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
115312025-04-30T06:30:08.563ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 41 reason = Signaled
115322025-04-30T06:30:08.563ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
115332025-04-30T06:30:08.563ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
115342025-04-30T06:30:08.563ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
115352025-04-30T06:30:08.563ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115362025-04-30T06:30:08.565ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115372025-04-30T06:30:08.571ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115382025-04-30T06:30:08.576ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
115392025-04-30T06:30:08.576ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
115402025-04-30T06:30:08.576ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115412025-04-30T06:30:08.576ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115422025-04-30T06:30:08.580ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
115432025-04-30T06:30:08.580ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
115442025-04-30T06:30:08.581ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: d3 00 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:63376 req_id = 18d8a2a4-dc9c-4029-8da4-18bcf275b330
115452025-04-30T06:30:08.581ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 54016,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63376 req_id = 18d8a2a4-dc9c-4029-8da4-18bcf275b330
115462025-04-30T06:30:08.581ZDEBGtest_image_create (store): query key key = _mgs._tcp
115472025-04-30T06:30:08.581ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
115482025-04-30T06:30:08.581ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63376 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 18d8a2a4-dc9c-4029-8da4-18bcf275b330
115492025-04-30T06:30:08.582ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3473, tv_nsec: 381128169 } })
115502025-04-30T06:30:08.582ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
115512025-04-30T06:30:08.582ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 23 4f 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e #O..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:59165 req_id = 36b0272a-36ba-41e9-b6cd-ac9213576bd4
115522025-04-30T06:30:08.582ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 9039,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59165 req_id = 36b0272a-36ba-41e9-b6cd-ac9213576bd4
115532025-04-30T06:30:08.582ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
115542025-04-30T06:30:08.582ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59165 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 36b0272a-36ba-41e9-b6cd-ac9213576bd4
115552025-04-30T06:30:08.624ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
115562025-04-30T06:30:08.624ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
115572025-04-30T06:30:08.624ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
115582025-04-30T06:30:08.624ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
115592025-04-30T06:30:08.624ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
115602025-04-30T06:30:08.625ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
115612025-04-30T06:30:08.625ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
115622025-04-30T06:30:08.626ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: bd d0 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:62601 req_id = d92a39af-bebe-438e-b3e5-4f4c66d2d171
115632025-04-30T06:30:08.626ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 48592,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62601 req_id = d92a39af-bebe-438e-b3e5-4f4c66d2d171
115642025-04-30T06:30:08.627ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
115652025-04-30T06:30:08.627ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48592, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:62601 req_id = d92a39af-bebe-438e-b3e5-4f4c66d2d171
115662025-04-30T06:30:08.628ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
115672025-04-30T06:30:08.628ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
115682025-04-30T06:30:08.628ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
115692025-04-30T06:30:08.629ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115702025-04-30T06:30:08.642ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
115712025-04-30T06:30:08.642ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
115722025-04-30T06:30:08.642ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
115732025-04-30T06:30:08.643ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
115742025-04-30T06:30:08.644ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ad90e56-b76a-4574-a621-77dcef8db9c0", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115752025-04-30T06:30:08.644ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
115762025-04-30T06:30:08.646ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "683743d7-1248-4262-b8e7-5a28bc54a905", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115772025-04-30T06:30:08.646ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
115782025-04-30T06:30:08.646ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
115792025-04-30T06:30:08.646ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
115802025-04-30T06:30:08.647ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
115812025-04-30T06:30:08.649ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1022768a-b7c6-40ee-adb7-6c0f39251481", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115822025-04-30T06:30:08.649ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
115832025-04-30T06:30:08.651ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "faa2613a-aecf-45f7-b7f0-a3da88cf77ff", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115842025-04-30T06:30:08.652ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
115852025-04-30T06:30:08.656ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "740e7a51-9184-45fa-94ba-f7e383c988e0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115862025-04-30T06:30:08.656ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
115872025-04-30T06:30:08.661ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e528686b-1464-43fe-91a8-de15ab053ff1", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115882025-04-30T06:30:08.662ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
115892025-04-30T06:30:08.667ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8fb0034-6a37-434b-92ed-211b1027e372", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115902025-04-30T06:30:08.668ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
115912025-04-30T06:30:08.671ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "da700361-45c4-45a9-8520-5da70b594264", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115922025-04-30T06:30:08.672ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
115932025-04-30T06:30:08.673ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "00c55cbc-0100-4914-aef6-bbbf63adc5d5", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115942025-04-30T06:30:08.673ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
115952025-04-30T06:30:08.677ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e38cd5e2-37e6-4192-835f-c374477e7ad5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115962025-04-30T06:30:08.678ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
115972025-04-30T06:30:08.680ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8cc1b45-41b0-44d3-bbbe-286b998f9838", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
115982025-04-30T06:30:08.680ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
115992025-04-30T06:30:08.685ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
116002025-04-30T06:30:08.685ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e8aa9f3-044b-4577-9148-ab18a4978d9f", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116012025-04-30T06:30:08.685ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
116022025-04-30T06:30:08.688ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b009561-bfbd-4285-a4af-795e4dd3d394", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116032025-04-30T06:30:08.688ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
116042025-04-30T06:30:08.690ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4348f336-a785-425d-a44f-5cbe437b4e68", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116052025-04-30T06:30:08.691ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
116062025-04-30T06:30:08.693ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd607d2d-a25f-46fa-a5f8-eb362d3299f1", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116072025-04-30T06:30:08.693ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
116082025-04-30T06:30:08.696ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0d87f68-d12c-4084-b694-2e370316dd0d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116092025-04-30T06:30:08.696ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
116102025-04-30T06:30:08.698ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b1fe952-6703-4423-8f65-f0e894241275", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116112025-04-30T06:30:08.698ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
116122025-04-30T06:30:08.700ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b3eb11e-2f23-44a4-afb3-c7b807e06a7e", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116132025-04-30T06:30:08.701ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
116142025-04-30T06:30:08.708ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b828dc55-56fc-4420-a9b1-1bf6feb668ea", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116152025-04-30T06:30:08.708ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
116162025-04-30T06:30:08.709ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40ec7c42-df0e-447c-98c2-dc1b6e27ea88", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116172025-04-30T06:30:08.709ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
116182025-04-30T06:30:08.711ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "20be4474-e501-4a06-a245-907d5b1babe3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116192025-04-30T06:30:08.711ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
116202025-04-30T06:30:08.713ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3b45889-fccc-4b44-a7a8-612335bc7313", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116212025-04-30T06:30:08.713ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
116222025-04-30T06:30:08.714ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c6fd124-359d-4962-8541-4ce967764eb5", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116232025-04-30T06:30:08.714ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
116242025-04-30T06:30:08.716ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2cd7599-7982-45d5-b7da-e0fe839f894e", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116252025-04-30T06:30:08.716ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
116262025-04-30T06:30:08.718ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ed73a0-0873-40e4-b196-195b8626d1ba", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116272025-04-30T06:30:08.718ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
116282025-04-30T06:30:08.723ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bf6e0b5-d6d1-4b40-acbf-d40da7cca921", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116292025-04-30T06:30:08.723ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
116302025-04-30T06:30:08.726ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "80a6ee78-d791-40ee-b99a-d3be81422989", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116312025-04-30T06:30:08.726ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
116322025-04-30T06:30:08.729ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "041f1782-ba8d-41a0-b590-960fe416f238", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116332025-04-30T06:30:08.730ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
116342025-04-30T06:30:08.735ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a78367e4-945a-4c07-a6d8-d2f7733da58d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116352025-04-30T06:30:08.735ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
116362025-04-30T06:30:08.736ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
116372025-04-30T06:30:08.736ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
116382025-04-30T06:30:08.736ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
116392025-04-30T06:30:08.736ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
116402025-04-30T06:30:08.739ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
116412025-04-30T06:30:08.743ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116422025-04-30T06:30:08.749ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
116432025-04-30T06:30:08.749ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
116442025-04-30T06:30:08.749ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
116452025-04-30T06:30:08.749ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
116462025-04-30T06:30:08.750ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f46d6726-2438-4bad-a935-f3b1389f9fa0", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116472025-04-30T06:30:08.750ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
116482025-04-30T06:30:08.752ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a84e4fe-a93f-49f6-904f-df5083438efa", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116492025-04-30T06:30:08.752ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
116502025-04-30T06:30:08.752ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
116512025-04-30T06:30:08.753ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
116522025-04-30T06:30:08.753ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
116532025-04-30T06:30:08.753ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "433391ca-0da0-40ef-9506-e780a95989a0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116542025-04-30T06:30:08.754ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
116552025-04-30T06:30:08.755ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb607f6e-bf67-4df0-987a-2f06a0d581ad", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116562025-04-30T06:30:08.755ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
116572025-04-30T06:30:08.756ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "069c0124-0032-4d1d-974e-e2a8be70c7a1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116582025-04-30T06:30:08.756ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
116592025-04-30T06:30:08.762ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8ee7046-6b18-48e7-95a2-66028be4c415", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116602025-04-30T06:30:08.762ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
116612025-04-30T06:30:08.768ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c923793-5b3f-45b9-bcfa-13b69f44f78d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116622025-04-30T06:30:08.768ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
116632025-04-30T06:30:08.772ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8358928-074d-4b42-96bb-085cc707e178", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116642025-04-30T06:30:08.772ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
116652025-04-30T06:30:08.776ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e84bd7df-eeff-459f-b204-987019cd9cd3", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116662025-04-30T06:30:08.776ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
116672025-04-30T06:30:08.785ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d24fa99-83ca-450b-9899-a08ed9b944a0", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116682025-04-30T06:30:08.785ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
116692025-04-30T06:30:08.798ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
116702025-04-30T06:30:08.798ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab9c7fdd-1086-4ea6-b65a-1e9b7fde0ad7", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116712025-04-30T06:30:08.799ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
116722025-04-30T06:30:08.809ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fcc2e1d-3adc-46cc-97ed-b34fd74d282e", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116732025-04-30T06:30:08.810ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
116742025-04-30T06:30:08.813ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b68b9e5-ea9d-405c-801d-b25436821570", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116752025-04-30T06:30:08.813ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
116762025-04-30T06:30:08.815ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aafcd64-da27-45d2-8378-66a135651daa", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116772025-04-30T06:30:08.815ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
116782025-04-30T06:30:08.817ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d16c5aa-7a99-4c05-af5e-e4fb5ad50fad", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116792025-04-30T06:30:08.817ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
116802025-04-30T06:30:08.819ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b8441b7-a542-49b6-b1ce-654b427cae6a", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
116812025-04-30T06:30:08.819ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
116822025-04-30T06:30:08.819ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
116832025-04-30T06:30:08.819ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
116842025-04-30T06:30:08.819ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116852025-04-30T06:30:08.820ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116862025-04-30T06:30:08.824ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116872025-04-30T06:30:08.831ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
116882025-04-30T06:30:08.831ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
116892025-04-30T06:30:08.831ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
116902025-04-30T06:30:08.831ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
116912025-04-30T06:30:08.832ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116922025-04-30T06:30:08.833ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116932025-04-30T06:30:08.840ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116942025-04-30T06:30:08.846ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
116952025-04-30T06:30:08.846ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
116962025-04-30T06:30:08.846ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116972025-04-30T06:30:08.846ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116982025-04-30T06:30:08.849ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
116992025-04-30T06:30:08.850ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
117002025-04-30T06:30:08.850ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
117012025-04-30T06:30:08.850ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
117022025-04-30T06:30:08.851ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
117032025-04-30T06:30:08.910ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
117042025-04-30T06:30:08.910ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
117052025-04-30T06:30:08.911ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:47642 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
117062025-04-30T06:30:08.912ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:47642 req_id = a7fb1da3-8dce-4733-97e5-29a2da952479 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
117072025-04-30T06:30:08.913ZINFOtest_image_create (dropshot): request completed latency_us = 536 local_addr = [::1]:42828 method = GET remote_addr = [::1]:47642 req_id = a7fb1da3-8dce-4733-97e5-29a2da952479 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
117082025-04-30T06:30:08.913ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117092025-04-30T06:30:08.920ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
117102025-04-30T06:30:08.920ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
117112025-04-30T06:30:08.921ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
117122025-04-30T06:30:08.923ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
117132025-04-30T06:30:08.924ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7fb1da3-8dce-4733-97e5-29a2da952479", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117142025-04-30T06:30:08.927ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
117152025-04-30T06:30:08.927ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
117162025-04-30T06:30:08.927ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
117172025-04-30T06:30:08.930ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
117182025-04-30T06:30:08.930ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
117192025-04-30T06:30:08.930ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
117202025-04-30T06:30:08.930ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117212025-04-30T06:30:08.931ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
117222025-04-30T06:30:08.935ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
117232025-04-30T06:30:08.935ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
117242025-04-30T06:30:08.940ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
117252025-04-30T06:30:08.944ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117262025-04-30T06:30:08.958ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
117272025-04-30T06:30:08.960ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
117282025-04-30T06:30:08.960ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117292025-04-30T06:30:08.962ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
117302025-04-30T06:30:09.002ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
117312025-04-30T06:30:09.003ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
117322025-04-30T06:30:09.003ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 439.932396ms iteration = 41 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
117332025-04-30T06:30:09.003ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 42 reason = Signaled
117342025-04-30T06:30:09.003ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
117352025-04-30T06:30:09.003ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
117362025-04-30T06:30:09.003ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
117372025-04-30T06:30:09.003ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117382025-04-30T06:30:09.004ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
117392025-04-30T06:30:09.005ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
117402025-04-30T06:30:09.008ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117412025-04-30T06:30:09.012ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
117422025-04-30T06:30:09.013ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
117432025-04-30T06:30:09.013ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117442025-04-30T06:30:09.013ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
117452025-04-30T06:30:09.017ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
117462025-04-30T06:30:09.017ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
117472025-04-30T06:30:09.018ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: b5 6c 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .l..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:64690 req_id = a25564bb-a37a-4385-a28c-7c20484ef67a
117482025-04-30T06:30:09.018ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 46444,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64690 req_id = a25564bb-a37a-4385-a28c-7c20484ef67a
117492025-04-30T06:30:09.018ZDEBGtest_image_create (store): query key key = _mgs._tcp
117502025-04-30T06:30:09.019ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
117512025-04-30T06:30:09.019ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:64690 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = a25564bb-a37a-4385-a28c-7c20484ef67a
117522025-04-30T06:30:09.019ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3473, tv_nsec: 818326257 } })
117532025-04-30T06:30:09.019ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
117542025-04-30T06:30:09.019ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: da f9 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56527 req_id = 5982a315-9c89-41b9-88a1-b7b01526a90c
117552025-04-30T06:30:09.019ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56057,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56527 req_id = 5982a315-9c89-41b9-88a1-b7b01526a90c
117562025-04-30T06:30:09.019ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
117572025-04-30T06:30:09.020ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56527 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 5982a315-9c89-41b9-88a1-b7b01526a90c
117582025-04-30T06:30:09.072ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
117592025-04-30T06:30:09.072ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
117602025-04-30T06:30:09.072ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
117612025-04-30T06:30:09.072ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
117622025-04-30T06:30:09.073ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
117632025-04-30T06:30:09.074ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
117642025-04-30T06:30:09.074ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: f0 a1 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:50439 req_id = c475d3b6-873b-40c5-94bd-3218dfa64dfd
117652025-04-30T06:30:09.074ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61601,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50439 req_id = c475d3b6-873b-40c5-94bd-3218dfa64dfd
117662025-04-30T06:30:09.074ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
117672025-04-30T06:30:09.075ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61601, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:50439 req_id = c475d3b6-873b-40c5-94bd-3218dfa64dfd
117682025-04-30T06:30:09.075ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
117692025-04-30T06:30:09.075ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
117702025-04-30T06:30:09.075ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
117712025-04-30T06:30:09.078ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117722025-04-30T06:30:09.084ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
117732025-04-30T06:30:09.084ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
117742025-04-30T06:30:09.084ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
117752025-04-30T06:30:09.084ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
117762025-04-30T06:30:09.086ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "42855f7b-5a84-403a-8f1b-315b9b94c57f", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117772025-04-30T06:30:09.086ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
117782025-04-30T06:30:09.088ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
117792025-04-30T06:30:09.088ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
117802025-04-30T06:30:09.089ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
117812025-04-30T06:30:09.090ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "46c216e6-4295-4b11-bd9e-90d4c7f7eee2", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117822025-04-30T06:30:09.091ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
117832025-04-30T06:30:09.095ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bcd7197-f724-4baa-b7da-243f9e5fd192", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117842025-04-30T06:30:09.095ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
117852025-04-30T06:30:09.108ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af62f0dd-74b1-42d7-a3d8-f149777fb6d4", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117862025-04-30T06:30:09.108ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
117872025-04-30T06:30:09.117ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "360f4ba8-72e5-4f5b-88e2-49f8d111405d", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117882025-04-30T06:30:09.118ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
117892025-04-30T06:30:09.139ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "da28ab1d-32e8-4c38-a5ff-23ee9dc101b8", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117902025-04-30T06:30:09.140ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
117912025-04-30T06:30:09.145ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
117922025-04-30T06:30:09.149ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "58dfb0d0-5a6f-425c-a0ef-10e107824968", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117932025-04-30T06:30:09.149ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
117942025-04-30T06:30:09.154ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c2ea456-c544-412e-85e9-cc28e5d9e452", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117952025-04-30T06:30:09.154ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
117962025-04-30T06:30:09.156ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4319663-84c3-480f-82ee-f3132aff1b7d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117972025-04-30T06:30:09.156ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
117982025-04-30T06:30:09.160ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee05ff2d-1727-4b5c-930e-adc7bef2731e", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
117992025-04-30T06:30:09.160ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
118002025-04-30T06:30:09.165ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cfad269-375b-4b15-9d3a-1cba30c684c6", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118012025-04-30T06:30:09.166ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
118022025-04-30T06:30:09.168ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d4d71df-7974-4973-aa8b-80a2d095e265", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118032025-04-30T06:30:09.169ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
118042025-04-30T06:30:09.171ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "302d6714-a647-4da7-b055-12cb96fda873", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118052025-04-30T06:30:09.171ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
118062025-04-30T06:30:09.175ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bed1b215-c51f-4446-a5f4-4dd0fc3c23ae", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118072025-04-30T06:30:09.175ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
118082025-04-30T06:30:09.179ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1be155fa-e1b1-4cd8-b8c2-c1b647fe2360", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118092025-04-30T06:30:09.179ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
118102025-04-30T06:30:09.182ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "367f57c0-b91d-4c0f-9766-7ef2feb5e005", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118112025-04-30T06:30:09.182ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
118122025-04-30T06:30:09.185ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "87fe71f0-c718-4a8e-9e46-2c03b9f2124a", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118132025-04-30T06:30:09.186ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
118142025-04-30T06:30:09.187ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "606baf75-ffd5-42c8-8de7-0670b6c54e89", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118152025-04-30T06:30:09.188ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
118162025-04-30T06:30:09.192ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "05f996ca-9bc0-45e6-a556-763a6c6fdacc", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118172025-04-30T06:30:09.192ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
118182025-04-30T06:30:09.193ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc4639fd-34c3-4e2c-834c-f027d0b1aa63", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118192025-04-30T06:30:09.194ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
118202025-04-30T06:30:09.197ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56620527-c7c9-487e-9628-ee6c8cf491a3", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118212025-04-30T06:30:09.197ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
118222025-04-30T06:30:09.197ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
118232025-04-30T06:30:09.197ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118242025-04-30T06:30:09.197ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
118252025-04-30T06:30:09.197ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
118262025-04-30T06:30:09.198ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
118272025-04-30T06:30:09.199ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "da2030cc-880d-4428-a3fe-7f60487e9439", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118282025-04-30T06:30:09.200ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
118292025-04-30T06:30:09.201ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118302025-04-30T06:30:09.210ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
118312025-04-30T06:30:09.210ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
118322025-04-30T06:30:09.210ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
118332025-04-30T06:30:09.211ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
118342025-04-30T06:30:09.215ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6da9ec3a-e5dd-4d0d-920e-252d58fcf7fa", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118352025-04-30T06:30:09.216ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
118362025-04-30T06:30:09.216ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
118372025-04-30T06:30:09.216ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
118382025-04-30T06:30:09.221ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
118392025-04-30T06:30:09.224ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d31a630a-93fd-461e-a83a-9f3e5b9c97a7", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118402025-04-30T06:30:09.224ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
118412025-04-30T06:30:09.228ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fafe45dd-5236-411e-b9da-8b2d97736e94", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118422025-04-30T06:30:09.228ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
118432025-04-30T06:30:09.230ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd9f36a6-d387-44ea-8630-1e4510d38987", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118442025-04-30T06:30:09.230ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
118452025-04-30T06:30:09.232ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d822dd70-6866-4fc5-9acf-77d609d0312d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118462025-04-30T06:30:09.232ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
118472025-04-30T06:30:09.234ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3f83a80-ddb6-4912-8f76-c8393b49ef77", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118482025-04-30T06:30:09.235ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
118492025-04-30T06:30:09.237ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5606532-3002-4cf2-8abd-b7dc70483aab", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118502025-04-30T06:30:09.238ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
118512025-04-30T06:30:09.240ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9cc618e-0b6e-416a-b118-45cf9f03aedd", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118522025-04-30T06:30:09.240ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
118532025-04-30T06:30:09.242ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "81c4db07-55cf-4f56-8593-77334a6355ba", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118542025-04-30T06:30:09.242ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
118552025-04-30T06:30:09.243ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb3e2c3c-4e4d-4b8a-a7c6-a79892ba9ca6", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118562025-04-30T06:30:09.243ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
118572025-04-30T06:30:09.245ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bd6819a-7595-4e9d-b216-dcd6b525dcac", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118582025-04-30T06:30:09.245ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
118592025-04-30T06:30:09.246ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5291fefc-bd61-45f1-9578-47ea8f17d9db", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118602025-04-30T06:30:09.246ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
118612025-04-30T06:30:09.247ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e7266ac-1788-4b60-ad12-4e0a67c9621b", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118622025-04-30T06:30:09.248ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
118632025-04-30T06:30:09.251ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e28cf4a4-da06-4344-b879-331353bff863", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118642025-04-30T06:30:09.252ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
118652025-04-30T06:30:09.253ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
118662025-04-30T06:30:09.255ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "70c0a49d-e243-44a5-a98a-bac5031ec966", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118672025-04-30T06:30:09.255ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
118682025-04-30T06:30:09.256ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "47b58d59-fbea-4ba2-8040-8aaed19f77ba", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118692025-04-30T06:30:09.257ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
118702025-04-30T06:30:09.260ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9654ce2a-bec6-49d9-8003-8b5984e8022b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118712025-04-30T06:30:09.261ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
118722025-04-30T06:30:09.263ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c999423-779e-4238-afe6-b2950ff1c920", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118732025-04-30T06:30:09.263ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
118742025-04-30T06:30:09.265ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "39bc4b85-878b-4f90-803b-07f7356eb238", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118752025-04-30T06:30:09.266ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
118762025-04-30T06:30:09.273ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "061af4f1-7e5b-430b-8f99-c4dd72a86b36", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118772025-04-30T06:30:09.274ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
118782025-04-30T06:30:09.276ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "70d93687-0935-4e52-bfc2-7ec911e3bdc5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118792025-04-30T06:30:09.276ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
118802025-04-30T06:30:09.280ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bb9cf21-e630-474d-856d-7e37f4eba17f", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118812025-04-30T06:30:09.281ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
118822025-04-30T06:30:09.283ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6364cb17-e924-4900-b71c-8e3b79899a38", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
118832025-04-30T06:30:09.283ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
118842025-04-30T06:30:09.284ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118852025-04-30T06:30:09.284ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
118862025-04-30T06:30:09.284ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118872025-04-30T06:30:09.285ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118882025-04-30T06:30:09.290ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118892025-04-30T06:30:09.299ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
118902025-04-30T06:30:09.299ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
118912025-04-30T06:30:09.299ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118922025-04-30T06:30:09.300ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
118932025-04-30T06:30:09.300ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118942025-04-30T06:30:09.300ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118952025-04-30T06:30:09.304ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
118962025-04-30T06:30:09.305ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118972025-04-30T06:30:09.305ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
118982025-04-30T06:30:09.312ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
118992025-04-30T06:30:09.312ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
119002025-04-30T06:30:09.312ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119012025-04-30T06:30:09.315ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
119022025-04-30T06:30:09.315ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
119032025-04-30T06:30:09.315ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119042025-04-30T06:30:09.315ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119052025-04-30T06:30:09.317ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
119062025-04-30T06:30:09.317ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
119072025-04-30T06:30:09.319ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119082025-04-30T06:30:09.327ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
119092025-04-30T06:30:09.327ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
119102025-04-30T06:30:09.327ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
119112025-04-30T06:30:09.328ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
119122025-04-30T06:30:09.328ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 84c912bc-5262-4972-b5b6-bfb86358c242 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
119132025-04-30T06:30:09.329ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 84c912bc-5262-4972-b5b6-bfb86358c242 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
119142025-04-30T06:30:09.329ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 84c912bc-5262-4972-b5b6-bfb86358c242 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
119152025-04-30T06:30:09.329ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 84c912bc-5262-4972-b5b6-bfb86358c242 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
119162025-04-30T06:30:09.424ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
119172025-04-30T06:30:09.424ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
119182025-04-30T06:30:09.426ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:58252 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
119192025-04-30T06:30:09.427ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
119202025-04-30T06:30:09.427ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
119212025-04-30T06:30:09.433ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:58252 req_id = 57a30378-9345-4cea-9319-86650301d570 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
119222025-04-30T06:30:09.435ZINFOtest_image_create (dropshot): request completed latency_us = 1954 local_addr = [::1]:42828 method = GET remote_addr = [::1]:58252 req_id = 57a30378-9345-4cea-9319-86650301d570 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
119232025-04-30T06:30:09.437ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
119242025-04-30T06:30:09.438ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
119252025-04-30T06:30:09.440ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
119262025-04-30T06:30:09.441ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
119272025-04-30T06:30:09.442ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
119282025-04-30T06:30:09.443ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
119292025-04-30T06:30:09.443ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
119302025-04-30T06:30:09.443ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "57a30378-9345-4cea-9319-86650301d570", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
119312025-04-30T06:30:09.446ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
119322025-04-30T06:30:09.446ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
119332025-04-30T06:30:09.446ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
119342025-04-30T06:30:09.448ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
119352025-04-30T06:30:09.449ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119362025-04-30T06:30:09.449ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
119372025-04-30T06:30:09.449ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119382025-04-30T06:30:09.450ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119392025-04-30T06:30:09.452ZINFOtest_image_create (dropshot_internal): request completed latency_us = 124012 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 84c912bc-5262-4972-b5b6-bfb86358c242 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
119402025-04-30T06:30:09.454ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "84c912bc-5262-4972-b5b6-bfb86358c242", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
119412025-04-30T06:30:09.458ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
119422025-04-30T06:30:09.461ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3a4caa7c-60ea-4ec3-8f54-f50e54ef6036 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
119432025-04-30T06:30:09.462ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3a4caa7c-60ea-4ec3-8f54-f50e54ef6036 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
119442025-04-30T06:30:09.462ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3a4caa7c-60ea-4ec3-8f54-f50e54ef6036 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
119452025-04-30T06:30:09.463ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3a4caa7c-60ea-4ec3-8f54-f50e54ef6036 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
119462025-04-30T06:30:09.463ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119472025-04-30T06:30:09.472ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
119482025-04-30T06:30:09.473ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
119492025-04-30T06:30:09.473ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119502025-04-30T06:30:09.473ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119512025-04-30T06:30:09.476ZINFOtest_image_create (dropshot_internal): request completed latency_us = 15512 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 3a4caa7c-60ea-4ec3-8f54-f50e54ef6036 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
119522025-04-30T06:30:09.478ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a4caa7c-60ea-4ec3-8f54-f50e54ef6036", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:08 GMT"} })
119532025-04-30T06:30:09.479ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
119542025-04-30T06:30:09.479ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
119552025-04-30T06:30:09.479ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
119562025-04-30T06:30:09.515ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119572025-04-30T06:30:09.515ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119582025-04-30T06:30:09.515ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
119592025-04-30T06:30:09.516ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
119602025-04-30T06:30:09.529ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
119612025-04-30T06:30:09.529ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
119622025-04-30T06:30:09.537ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
119632025-04-30T06:30:09.537ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119642025-04-30T06:30:09.549ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
119652025-04-30T06:30:09.549ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
119662025-04-30T06:30:09.549ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 546.619544ms iteration = 42 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
119672025-04-30T06:30:09.549ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 43 reason = Signaled
119682025-04-30T06:30:09.549ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
119692025-04-30T06:30:09.549ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119702025-04-30T06:30:09.550ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
119712025-04-30T06:30:09.550ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119722025-04-30T06:30:09.550ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119732025-04-30T06:30:09.552ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
119742025-04-30T06:30:09.558ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119752025-04-30T06:30:09.564ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
119762025-04-30T06:30:09.564ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
119772025-04-30T06:30:09.564ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119782025-04-30T06:30:09.564ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119792025-04-30T06:30:09.578ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
119802025-04-30T06:30:09.578ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
119812025-04-30T06:30:09.580ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 07 b6 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:50299 req_id = b7bbb8b9-a6a5-4705-a1e3-6da56e00ca10
119822025-04-30T06:30:09.580ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1974,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50299 req_id = b7bbb8b9-a6a5-4705-a1e3-6da56e00ca10
119832025-04-30T06:30:09.580ZDEBGtest_image_create (store): query key key = _mgs._tcp
119842025-04-30T06:30:09.580ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
119852025-04-30T06:30:09.581ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:50299 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = b7bbb8b9-a6a5-4705-a1e3-6da56e00ca10
119862025-04-30T06:30:09.581ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3474, tv_nsec: 380700011 } })
119872025-04-30T06:30:09.581ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
119882025-04-30T06:30:09.582ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 8d d0 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:49954 req_id = e60db68b-6ac0-46bf-aac6-b790e31a96a9
119892025-04-30T06:30:09.582ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 36304,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49954 req_id = e60db68b-6ac0-46bf-aac6-b790e31a96a9
119902025-04-30T06:30:09.582ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
119912025-04-30T06:30:09.582ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:49954 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = e60db68b-6ac0-46bf-aac6-b790e31a96a9
119922025-04-30T06:30:09.644ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
119932025-04-30T06:30:09.645ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
119942025-04-30T06:30:09.645ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119952025-04-30T06:30:09.645ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
119962025-04-30T06:30:09.645ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
119972025-04-30T06:30:09.646ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
119982025-04-30T06:30:09.646ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
119992025-04-30T06:30:09.647ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 01 a4 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:65123 req_id = 36dc4651-2be9-4628-86f4-7e606cdf44f6
120002025-04-30T06:30:09.647ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 420,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65123 req_id = 36dc4651-2be9-4628-86f4-7e606cdf44f6
120012025-04-30T06:30:09.647ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
120022025-04-30T06:30:09.647ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 420, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:65123 req_id = 36dc4651-2be9-4628-86f4-7e606cdf44f6
120032025-04-30T06:30:09.648ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
120042025-04-30T06:30:09.648ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
120052025-04-30T06:30:09.648ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
120062025-04-30T06:30:09.650ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120072025-04-30T06:30:09.663ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
120082025-04-30T06:30:09.663ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
120092025-04-30T06:30:09.663ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
120102025-04-30T06:30:09.664ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
120112025-04-30T06:30:09.667ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "57150018-f50c-4699-a947-b513f6567de4", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120122025-04-30T06:30:09.668ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
120132025-04-30T06:30:09.668ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
120142025-04-30T06:30:09.668ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
120152025-04-30T06:30:09.669ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
120162025-04-30T06:30:09.673ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f31f1736-265d-434c-8ebf-d5ca1540ba62", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120172025-04-30T06:30:09.673ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
120182025-04-30T06:30:09.683ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "85990c18-9fe1-4d7a-b27d-4e8c4fc17328", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120192025-04-30T06:30:09.683ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
120202025-04-30T06:30:09.690ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "502a03e6-0ea9-4ba1-8333-559b01b70499", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120212025-04-30T06:30:09.690ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
120222025-04-30T06:30:09.697ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "16d1cdf0-14d7-469e-bac1-4844feffeea7", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120232025-04-30T06:30:09.697ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
120242025-04-30T06:30:09.701ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a33be2e3-531a-4218-a189-41eafa0815a3", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120252025-04-30T06:30:09.702ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
120262025-04-30T06:30:09.712ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
120272025-04-30T06:30:09.714ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5910c290-3b42-4c0c-b807-c07c650b43bb", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120282025-04-30T06:30:09.715ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
120292025-04-30T06:30:09.717ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba9fb4fa-66a2-4c3b-8880-d6e33b1af21c", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120302025-04-30T06:30:09.717ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
120312025-04-30T06:30:09.718ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ce516a1-e5ea-41a9-bd21-804b48d4c3a7", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120322025-04-30T06:30:09.719ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
120332025-04-30T06:30:09.720ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "209b973c-cc11-48d2-93b1-d2713aa5df3d", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120342025-04-30T06:30:09.720ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
120352025-04-30T06:30:09.721ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c984f1d-faff-4e58-b836-712fe2f19f83", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120362025-04-30T06:30:09.722ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
120372025-04-30T06:30:09.723ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "413b525a-54a1-4e7c-911e-139e4c4d64de", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120382025-04-30T06:30:09.724ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
120392025-04-30T06:30:09.728ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7252751-6331-4239-908a-60e99e21b25e", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120402025-04-30T06:30:09.728ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
120412025-04-30T06:30:09.728ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
120422025-04-30T06:30:09.729ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: ec d1 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:52429 req_id = 035e50ec-d0bd-417c-9d4a-7067056677a5
120432025-04-30T06:30:09.729ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60625,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52429 req_id = 035e50ec-d0bd-417c-9d4a-7067056677a5
120442025-04-30T06:30:09.730ZDEBGtest_image_create (store): query key key = _dendrite._tcp
120452025-04-30T06:30:09.730ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
120462025-04-30T06:30:09.730ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:52429 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 035e50ec-d0bd-417c-9d4a-7067056677a5
120472025-04-30T06:30:09.731ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3474, tv_nsec: 529946174 } })
120482025-04-30T06:30:09.731ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
120492025-04-30T06:30:09.731ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 74 65 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e te..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:61996 req_id = 127d9b16-7527-4979-aca8-5bf7cb5e25e9
120502025-04-30T06:30:09.731ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 29797,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61996 req_id = 127d9b16-7527-4979-aca8-5bf7cb5e25e9
120512025-04-30T06:30:09.732ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
120522025-04-30T06:30:09.733ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:61996 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 127d9b16-7527-4979-aca8-5bf7cb5e25e9
120532025-04-30T06:30:09.733ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector
120542025-04-30T06:30:09.795ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector zone_address = ::1
120552025-04-30T06:30:09.795ZDEBGtest_image_create (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[::1]:12225/local/switch-id
120562025-04-30T06:30:09.795ZDEBGtest_image_create (MgsClient): client response background_task = nat_v4_garbage_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
120572025-04-30T06:30:09.795ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = nat_v4_garbage_collector reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
120582025-04-30T06:30:09.797ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = nat_v4_garbage_collector
120592025-04-30T06:30:09.797ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
120602025-04-30T06:30:09.797ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
120612025-04-30T06:30:09.797ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
120622025-04-30T06:30:09.797ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
120632025-04-30T06:30:09.798ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
120642025-04-30T06:30:09.799ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d970322-6397-4dd2-bc59-cb2e74f548fa", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120652025-04-30T06:30:09.799ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
120662025-04-30T06:30:09.801ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120672025-04-30T06:30:09.807ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
120682025-04-30T06:30:09.807ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
120692025-04-30T06:30:09.807ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
120702025-04-30T06:30:09.808ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
120712025-04-30T06:30:09.810ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6517d786-0a91-45ef-8b00-735f408672c2", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120722025-04-30T06:30:09.810ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
120732025-04-30T06:30:09.810ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
120742025-04-30T06:30:09.810ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
120752025-04-30T06:30:09.811ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
120762025-04-30T06:30:09.816ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "644b80f1-c467-40e1-9d32-c88d89810c1c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120772025-04-30T06:30:09.816ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
120782025-04-30T06:30:09.820ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "066dd491-32ae-49c3-94fb-97e281ab823b", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120792025-04-30T06:30:09.820ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
120802025-04-30T06:30:09.824ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1881509a-d419-4cfd-8df5-d10301f5f611", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120812025-04-30T06:30:09.824ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
120822025-04-30T06:30:09.827ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "35573a6e-6dfe-49b1-b4b0-df6f83dc48fb", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120832025-04-30T06:30:09.827ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
120842025-04-30T06:30:09.828ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bebbe28-00af-4baf-ba66-5bf049c1aa65", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120852025-04-30T06:30:09.828ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
120862025-04-30T06:30:09.829ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3165bfcf-6e0e-4493-b65f-fbefec0a7030", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120872025-04-30T06:30:09.829ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
120882025-04-30T06:30:09.830ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "036688b2-f511-46bd-89b2-2cf04352dfb4", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120892025-04-30T06:30:09.830ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
120902025-04-30T06:30:09.832ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd2ee22-5f19-4746-ad0c-ea8bfd47c5c3", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120912025-04-30T06:30:09.832ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
120922025-04-30T06:30:09.836ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "82aa3454-1884-4a1e-b675-b5a47acb839a", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120932025-04-30T06:30:09.836ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
120942025-04-30T06:30:09.839ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "485b8377-1f02-4bfe-a021-1a7fbf646885", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120952025-04-30T06:30:09.839ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
120962025-04-30T06:30:09.841ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
120972025-04-30T06:30:09.842ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7f7c23c-f7c0-49c3-a1ce-b9b8d63a4279", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
120982025-04-30T06:30:09.842ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
120992025-04-30T06:30:09.844ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a784d09-eb1f-4125-9b1e-cadcc9e0cd8f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121002025-04-30T06:30:09.844ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
121012025-04-30T06:30:09.845ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
121022025-04-30T06:30:09.847ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 9f 45 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .E..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:65143 req_id = 143d5552-9d45-4e0a-833e-95b7852c97e3
121032025-04-30T06:30:09.847ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 40773,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65143 req_id = 143d5552-9d45-4e0a-833e-95b7852c97e3
121042025-04-30T06:30:09.847ZDEBGtest_image_create (store): query key key = _dendrite._tcp
121052025-04-30T06:30:09.848ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
121062025-04-30T06:30:09.848ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:65143 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 143d5552-9d45-4e0a-833e-95b7852c97e3
121072025-04-30T06:30:09.848ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3474, tv_nsec: 647501234 } })
121082025-04-30T06:30:09.848ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
121092025-04-30T06:30:09.849ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 7e c9 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ~...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:60758 req_id = 801ad93b-7397-46bb-9505-cdd786491d1f
121102025-04-30T06:30:09.849ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 32457,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60758 req_id = 801ad93b-7397-46bb-9505-cdd786491d1f
121112025-04-30T06:30:09.849ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
121122025-04-30T06:30:09.849ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:60758 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 801ad93b-7397-46bb-9505-cdd786491d1f
121132025-04-30T06:30:09.851ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager
121142025-04-30T06:30:09.934ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager zone_address = ::1
121152025-04-30T06:30:09.934ZDEBGtest_image_create (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[::1]:12225/local/switch-id
121162025-04-30T06:30:09.934ZDEBGtest_image_create (MgsClient): client response background_task = bfd_manager result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
121172025-04-30T06:30:09.934ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = bfd_manager reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
121182025-04-30T06:30:09.935ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = bfd_manager
121192025-04-30T06:30:09.936ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
121202025-04-30T06:30:09.936ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
121212025-04-30T06:30:09.936ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
121222025-04-30T06:30:09.936ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
121232025-04-30T06:30:09.937ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
121242025-04-30T06:30:09.939ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0eecdc21-3131-4ea7-9251-3f7bbb1d2477", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121252025-04-30T06:30:09.939ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
121262025-04-30T06:30:09.941ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121272025-04-30T06:30:09.948ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
121282025-04-30T06:30:09.948ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
121292025-04-30T06:30:09.948ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
121302025-04-30T06:30:09.949ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
121312025-04-30T06:30:09.953ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
121322025-04-30T06:30:09.953ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
121332025-04-30T06:30:09.953ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
121342025-04-30T06:30:09.955ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7808d971-40dd-4279-9aea-992fc0a92ab2", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121352025-04-30T06:30:09.955ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
121362025-04-30T06:30:09.958ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5206b8ab-0233-47a6-a1ef-07a65380ae88", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121372025-04-30T06:30:09.958ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
121382025-04-30T06:30:09.959ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a965b903-9635-413d-8042-5ecb38480abc", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121392025-04-30T06:30:09.959ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
121402025-04-30T06:30:09.960ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "99648c4d-cc9a-4247-ac42-bbaac3773c3f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121412025-04-30T06:30:09.961ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
121422025-04-30T06:30:09.962ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f1b3aab-75fc-4f48-9b3d-ddd4a40afb4a", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121432025-04-30T06:30:09.962ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
121442025-04-30T06:30:09.963ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a8d55ca-95e9-46f8-adac-f84090c5af9f", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121452025-04-30T06:30:09.963ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
121462025-04-30T06:30:09.966ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f886db79-9d0c-4249-b20b-6448366ce780", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121472025-04-30T06:30:09.966ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
121482025-04-30T06:30:09.970ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
121492025-04-30T06:30:09.971ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: ee ee 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:61977 req_id = 86829ab3-f8ec-4190-b80d-d3828a884de5
121502025-04-30T06:30:09.971ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61166,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61977 req_id = 86829ab3-f8ec-4190-b80d-d3828a884de5
121512025-04-30T06:30:09.972ZDEBGtest_image_create (store): query key key = _dendrite._tcp
121522025-04-30T06:30:09.972ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
121532025-04-30T06:30:09.972ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:61977 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 86829ab3-f8ec-4190-b80d-d3828a884de5
121542025-04-30T06:30:09.972ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d0bd6e0-71be-4d5c-9f55-875997d60ab7", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121552025-04-30T06:30:09.972ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
121562025-04-30T06:30:09.973ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3474, tv_nsec: 772410257 } })
121572025-04-30T06:30:09.973ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
121582025-04-30T06:30:09.974ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 47 e2 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e G...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56621 req_id = 55248f73-bfe7-4736-a1c9-4fe6ab786bc4
121592025-04-30T06:30:09.974ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 18402,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56621 req_id = 55248f73-bfe7-4736-a1c9-4fe6ab786bc4
121602025-04-30T06:30:09.974ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
121612025-04-30T06:30:09.975ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56621 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 55248f73-bfe7-4736-a1c9-4fe6ab786bc4
121622025-04-30T06:30:09.975ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
121632025-04-30T06:30:10.060ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc zone_address = ::1
121642025-04-30T06:30:10.060ZDEBGtest_image_create (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc uri = http://[::1]:12225/local/switch-id
121652025-04-30T06:30:10.060ZDEBGtest_image_create (MgsClient): client response background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
121662025-04-30T06:30:10.060ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
121672025-04-30T06:30:10.062ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
121682025-04-30T06:30:10.076ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e95c4e87-a7c7-457e-b58f-c62ded44744c", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121692025-04-30T06:30:10.077ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
121702025-04-30T06:30:10.081ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
121712025-04-30T06:30:10.083ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "58aeb5ab-74a9-4ccc-8692-c0c3e2b0d9a0", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121722025-04-30T06:30:10.083ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
121732025-04-30T06:30:10.087ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d180e4cd-9158-4a73-8b35-acb011d5e9f5", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121742025-04-30T06:30:10.087ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
121752025-04-30T06:30:10.091ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "104c568b-9df9-46b9-b6b8-81c9731a8f28", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121762025-04-30T06:30:10.091ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
121772025-04-30T06:30:10.096ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a27de96a-3aac-4041-bd45-d9553f8635c2", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121782025-04-30T06:30:10.096ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
121792025-04-30T06:30:10.097ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "61608891-5db3-47ba-88d6-c63c7ecf6e2c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121802025-04-30T06:30:10.097ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
121812025-04-30T06:30:10.098ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5aae407-081a-4c48-b913-2dc469a39477", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121822025-04-30T06:30:10.098ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
121832025-04-30T06:30:10.099ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a28d5a9-4eab-4bda-9d7e-6fa10990b14b", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121842025-04-30T06:30:10.099ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
121852025-04-30T06:30:10.101ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "33cdcdfb-15dd-4ee4-b1d6-169bfd9515fb", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
121862025-04-30T06:30:10.101ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
121872025-04-30T06:30:10.101ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
121882025-04-30T06:30:10.101ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
121892025-04-30T06:30:10.101ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
121902025-04-30T06:30:10.102ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
121912025-04-30T06:30:10.104ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121922025-04-30T06:30:10.111ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
121932025-04-30T06:30:10.111ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
121942025-04-30T06:30:10.111ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
121952025-04-30T06:30:10.111ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
121962025-04-30T06:30:10.111ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
121972025-04-30T06:30:10.112ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
121982025-04-30T06:30:10.117ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121992025-04-30T06:30:10.121ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
122002025-04-30T06:30:10.121ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
122012025-04-30T06:30:10.121ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
122022025-04-30T06:30:10.121ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
122032025-04-30T06:30:10.136ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
122042025-04-30T06:30:10.136ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
122052025-04-30T06:30:10.136ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
122062025-04-30T06:30:10.136ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
122072025-04-30T06:30:10.137ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
122082025-04-30T06:30:10.201ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
122092025-04-30T06:30:10.202ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
122102025-04-30T06:30:10.207ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:51821 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
122112025-04-30T06:30:10.208ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:51821 req_id = b23b9af1-7556-4e63-bb16-626ac02a6cf4 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
122122025-04-30T06:30:10.208ZINFOtest_image_create (dropshot): request completed latency_us = 506 local_addr = [::1]:42828 method = GET remote_addr = [::1]:51821 req_id = b23b9af1-7556-4e63-bb16-626ac02a6cf4 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
122132025-04-30T06:30:10.208ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b23b9af1-7556-4e63-bb16-626ac02a6cf4", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122142025-04-30T06:30:10.211ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
122152025-04-30T06:30:10.211ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
122162025-04-30T06:30:10.211ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
122172025-04-30T06:30:10.219ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
122182025-04-30T06:30:10.219ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
122192025-04-30T06:30:10.220ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
122202025-04-30T06:30:10.220ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
122212025-04-30T06:30:10.221ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
122222025-04-30T06:30:10.222ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122232025-04-30T06:30:10.234ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
122242025-04-30T06:30:10.234ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
122252025-04-30T06:30:10.234ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
122262025-04-30T06:30:10.236ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
122272025-04-30T06:30:10.238ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122282025-04-30T06:30:10.245ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
122292025-04-30T06:30:10.245ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
122302025-04-30T06:30:10.245ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
122312025-04-30T06:30:10.246ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
122322025-04-30T06:30:10.247ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
122332025-04-30T06:30:10.247ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
122342025-04-30T06:30:10.247ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
122352025-04-30T06:30:10.274ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
122362025-04-30T06:30:10.274ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
122372025-04-30T06:30:10.274ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 724.954795ms iteration = 43 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
122382025-04-30T06:30:10.274ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 44 reason = Signaled
122392025-04-30T06:30:10.275ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
122402025-04-30T06:30:10.275ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
122412025-04-30T06:30:10.275ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
122422025-04-30T06:30:10.275ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
122432025-04-30T06:30:10.275ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
122442025-04-30T06:30:10.279ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122452025-04-30T06:30:10.285ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
122462025-04-30T06:30:10.285ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
122472025-04-30T06:30:10.285ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
122482025-04-30T06:30:10.286ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
122492025-04-30T06:30:10.290ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
122502025-04-30T06:30:10.291ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
122512025-04-30T06:30:10.291ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
122522025-04-30T06:30:10.292ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 2a dd 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 *............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:65183 req_id = c6637d7d-fa09-4e53-bc26-8e395f274795
122532025-04-30T06:30:10.292ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 10973,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65183 req_id = c6637d7d-fa09-4e53-bc26-8e395f274795
122542025-04-30T06:30:10.293ZDEBGtest_image_create (store): query key key = _mgs._tcp
122552025-04-30T06:30:10.293ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
122562025-04-30T06:30:10.293ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:65183 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = c6637d7d-fa09-4e53-bc26-8e395f274795
122572025-04-30T06:30:10.293ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3475, tv_nsec: 92660315 } })
122582025-04-30T06:30:10.293ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
122592025-04-30T06:30:10.294ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 1d 90 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:53387 req_id = 72e976b5-b89f-414c-8df6-9d8fe9146b20
122602025-04-30T06:30:10.294ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 7568,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:53387 req_id = 72e976b5-b89f-414c-8df6-9d8fe9146b20
122612025-04-30T06:30:10.294ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
122622025-04-30T06:30:10.294ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:53387 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 72e976b5-b89f-414c-8df6-9d8fe9146b20
122632025-04-30T06:30:10.353ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
122642025-04-30T06:30:10.353ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
122652025-04-30T06:30:10.353ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
122662025-04-30T06:30:10.353ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
122672025-04-30T06:30:10.353ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
122682025-04-30T06:30:10.354ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
122692025-04-30T06:30:10.355ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 1b 1d 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:49264 req_id = 64e54f26-deeb-4efb-8441-6ff0246739c9
122702025-04-30T06:30:10.355ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 6941,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49264 req_id = 64e54f26-deeb-4efb-8441-6ff0246739c9
122712025-04-30T06:30:10.355ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
122722025-04-30T06:30:10.355ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6941, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:49264 req_id = 64e54f26-deeb-4efb-8441-6ff0246739c9
122732025-04-30T06:30:10.355ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
122742025-04-30T06:30:10.355ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
122752025-04-30T06:30:10.355ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
122762025-04-30T06:30:10.357ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122772025-04-30T06:30:10.367ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
122782025-04-30T06:30:10.367ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
122792025-04-30T06:30:10.367ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
122802025-04-30T06:30:10.369ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
122812025-04-30T06:30:10.371ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd5496a0-9718-4731-bb10-20d181cad42a", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122822025-04-30T06:30:10.371ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
122832025-04-30T06:30:10.372ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
122842025-04-30T06:30:10.372ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
122852025-04-30T06:30:10.373ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
122862025-04-30T06:30:10.374ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e9f62ab-2e9b-43a9-8cb4-d76e464e5f7a", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122872025-04-30T06:30:10.375ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
122882025-04-30T06:30:10.378ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c58b6cda-9e28-4dda-9c43-f9ea20b9afed", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122892025-04-30T06:30:10.378ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
122902025-04-30T06:30:10.380ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f03ce72-a1d2-41fc-ad2c-a57ab31c4e4f", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122912025-04-30T06:30:10.380ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
122922025-04-30T06:30:10.384ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "918c7ad1-10d3-4394-96d7-ad441a6a2fc5", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122932025-04-30T06:30:10.384ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
122942025-04-30T06:30:10.389ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ee44c2f-57fe-44ce-805d-5696bb9234ba", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122952025-04-30T06:30:10.389ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
122962025-04-30T06:30:10.393ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "56a776c7-681e-4b60-ae33-4cd19be2d662", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122972025-04-30T06:30:10.393ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
122982025-04-30T06:30:10.395ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e6f0dcf-5f30-414f-a3f2-0989f4a5c721", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
122992025-04-30T06:30:10.395ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
123002025-04-30T06:30:10.397ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "12a986c1-b765-4a34-bc81-d568509e328f", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123012025-04-30T06:30:10.397ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
123022025-04-30T06:30:10.409ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "12e92643-0dac-4131-a130-5aab65a44a95", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123032025-04-30T06:30:10.409ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
123042025-04-30T06:30:10.410ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
123052025-04-30T06:30:10.413ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8198b9a-169a-4a6c-a65d-59194099395a", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123062025-04-30T06:30:10.413ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
123072025-04-30T06:30:10.414ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b7a218f-1896-4f3f-a688-a1ea8b95b22d", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123082025-04-30T06:30:10.414ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
123092025-04-30T06:30:10.415ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf2bae44-2d69-43e0-8705-1380b6f6650f", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123102025-04-30T06:30:10.416ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
123112025-04-30T06:30:10.418ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
123122025-04-30T06:30:10.418ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
123132025-04-30T06:30:10.420ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
123142025-04-30T06:30:10.421ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
123152025-04-30T06:30:10.421ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
123162025-04-30T06:30:10.421ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
123172025-04-30T06:30:10.422ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0485c68f-f6bf-4020-b98c-e0ff249ef55c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123182025-04-30T06:30:10.422ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
123192025-04-30T06:30:10.425ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccffb6ca-86d1-425d-a002-8c5f95a0cdc6", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123202025-04-30T06:30:10.425ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
123212025-04-30T06:30:10.429ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ed15cef-f175-4705-852e-4861311887ad", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123222025-04-30T06:30:10.429ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
123232025-04-30T06:30:10.431ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d880bce1-7f32-4be7-ad2e-403ff124882c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123242025-04-30T06:30:10.431ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
123252025-04-30T06:30:10.434ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e95c636-a253-4cbb-ab18-4ecf66ce2661", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123262025-04-30T06:30:10.434ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
123272025-04-30T06:30:10.436ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2a8a191-67fe-4e15-acb9-aa9911252fe3", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123282025-04-30T06:30:10.437ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
123292025-04-30T06:30:10.438ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "606568cd-029d-4b6e-9983-7cc29a16e7c4", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123302025-04-30T06:30:10.438ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
123312025-04-30T06:30:10.439ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f83c448a-5067-4b42-9abc-6adecf69c330", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123322025-04-30T06:30:10.440ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
123332025-04-30T06:30:10.442ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c60a2db2-9375-4ad4-b842-dbf365e506b4", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123342025-04-30T06:30:10.442ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
123352025-04-30T06:30:10.443ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3c14b99-8e64-4435-9749-0ec4f94f7231", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123362025-04-30T06:30:10.444ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
123372025-04-30T06:30:10.445ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "22775265-9ce8-4d26-aa5c-24c6e816da91", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123382025-04-30T06:30:10.446ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
123392025-04-30T06:30:10.448ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4934ae8a-57ac-47e0-8348-b1cc8ac59a5b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123402025-04-30T06:30:10.448ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
123412025-04-30T06:30:10.451ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9b80138-c9fd-4159-afdf-b8f019bf5784", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123422025-04-30T06:30:10.451ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
123432025-04-30T06:30:10.452ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c0abbea-4352-474f-ad73-011e4777efe3", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123442025-04-30T06:30:10.452ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
123452025-04-30T06:30:10.454ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "796d462f-965d-4c61-9840-742fa031d525", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123462025-04-30T06:30:10.454ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
123472025-04-30T06:30:10.463ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
123482025-04-30T06:30:10.463ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
123492025-04-30T06:30:10.463ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
123502025-04-30T06:30:10.463ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
123512025-04-30T06:30:10.464ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
123522025-04-30T06:30:10.466ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "038f12f5-5821-4c9c-87c8-2b691bf1e0f5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123532025-04-30T06:30:10.467ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
123542025-04-30T06:30:10.468ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123552025-04-30T06:30:10.495ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
123562025-04-30T06:30:10.500ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
123572025-04-30T06:30:10.500ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
123582025-04-30T06:30:10.502ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
123592025-04-30T06:30:10.505ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
123602025-04-30T06:30:10.505ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
123612025-04-30T06:30:10.506ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
123622025-04-30T06:30:10.521ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
123632025-04-30T06:30:10.522ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
123642025-04-30T06:30:10.522ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
123652025-04-30T06:30:10.524ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
123662025-04-30T06:30:10.535ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
123672025-04-30T06:30:10.535ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
123682025-04-30T06:30:10.547ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
123692025-04-30T06:30:10.547ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
123702025-04-30T06:30:10.555ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97e3f7d8-15be-4774-9275-e745ac406bd5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123712025-04-30T06:30:10.555ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
123722025-04-30T06:30:10.561ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "734ff10b-c8ef-4be4-bd96-50e73c707754", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123732025-04-30T06:30:10.561ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
123742025-04-30T06:30:10.570ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "247d07ba-d202-4037-ba2e-acbb97cbf748", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123752025-04-30T06:30:10.574ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
123762025-04-30T06:30:10.578ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
123772025-04-30T06:30:10.580ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "837d7843-85d2-4aec-8a53-48ad6f795c6c", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123782025-04-30T06:30:10.581ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
123792025-04-30T06:30:10.582ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "942ef52c-a3d6-4533-899c-60b59652e34c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123802025-04-30T06:30:10.583ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
123812025-04-30T06:30:10.585ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7718d761-3404-4ee4-8895-7a16159ee9ce", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123822025-04-30T06:30:10.585ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
123832025-04-30T06:30:10.593ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d977f16d-73ad-44f8-a535-0d9755c1c65c", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123842025-04-30T06:30:10.593ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
123852025-04-30T06:30:10.598ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "badd0b4d-4435-4b78-932e-5dd6b4c9d9ad", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123862025-04-30T06:30:10.598ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
123872025-04-30T06:30:10.602ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7dbd46b-ad98-4925-87da-d4a5bbc10cde", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123882025-04-30T06:30:10.602ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
123892025-04-30T06:30:10.605ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f9c3820-cc3b-488b-836a-343367db50a5", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123902025-04-30T06:30:10.605ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
123912025-04-30T06:30:10.609ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa9cb089-56dd-4738-bf03-e23d2cdf16be", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123922025-04-30T06:30:10.609ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
123932025-04-30T06:30:10.613ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8425f622-70c1-41d8-863f-286464831e89", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123942025-04-30T06:30:10.613ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
123952025-04-30T06:30:10.614ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2a0a65a-1019-4823-8cdb-cabfa33b76e7", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123962025-04-30T06:30:10.614ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
123972025-04-30T06:30:10.616ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bdaf9ee-9d56-4a7e-b31b-6ce22cafb76a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
123982025-04-30T06:30:10.616ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
123992025-04-30T06:30:10.617ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cee22a4f-2ee4-4a1b-bc01-167861d589c0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
124002025-04-30T06:30:10.617ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
124012025-04-30T06:30:10.618ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f477fca4-0f42-4116-a73a-a9506f097809", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:09 GMT"} })
124022025-04-30T06:30:10.618ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
124032025-04-30T06:30:10.619ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
124042025-04-30T06:30:10.619ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
124052025-04-30T06:30:10.619ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
124062025-04-30T06:30:10.620ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
124072025-04-30T06:30:10.623ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124082025-04-30T06:30:10.629ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
124092025-04-30T06:30:10.630ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
124102025-04-30T06:30:10.630ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
124112025-04-30T06:30:10.630ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
124122025-04-30T06:30:10.630ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
124132025-04-30T06:30:10.630ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
124142025-04-30T06:30:10.631ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
124152025-04-30T06:30:10.631ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
124162025-04-30T06:30:10.631ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
124172025-04-30T06:30:10.631ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
124182025-04-30T06:30:10.632ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
124192025-04-30T06:30:10.632ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
124202025-04-30T06:30:10.634ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124212025-04-30T06:30:10.650ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
124222025-04-30T06:30:10.650ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
124232025-04-30T06:30:10.650ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
124242025-04-30T06:30:10.651ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
124252025-04-30T06:30:10.653ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124262025-04-30T06:30:10.666ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
124272025-04-30T06:30:10.666ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
124282025-04-30T06:30:10.666ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
124292025-04-30T06:30:10.667ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
124302025-04-30T06:30:10.746ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
124312025-04-30T06:30:10.746ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
124322025-04-30T06:30:10.747ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:39485 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
124332025-04-30T06:30:10.747ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:39485 req_id = 36b406c7-569d-46d6-964d-958ff0b466af sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
124342025-04-30T06:30:10.748ZINFOtest_image_create (dropshot): request completed latency_us = 461 local_addr = [::1]:42828 method = GET remote_addr = [::1]:39485 req_id = 36b406c7-569d-46d6-964d-958ff0b466af response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
124352025-04-30T06:30:10.748ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
124362025-04-30T06:30:10.748ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
124372025-04-30T06:30:10.749ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
124382025-04-30T06:30:10.749ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "36b406c7-569d-46d6-964d-958ff0b466af", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
124392025-04-30T06:30:10.753ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
124402025-04-30T06:30:10.753ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
124412025-04-30T06:30:10.753ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
124422025-04-30T06:30:10.757ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
124432025-04-30T06:30:10.757ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
124442025-04-30T06:30:10.757ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
124452025-04-30T06:30:10.757ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
124462025-04-30T06:30:10.758ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
124472025-04-30T06:30:10.763ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124482025-04-30T06:30:10.781ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
124492025-04-30T06:30:10.782ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
124502025-04-30T06:30:10.782ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
124512025-04-30T06:30:10.785ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
124522025-04-30T06:30:10.822ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
124532025-04-30T06:30:10.838ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
124542025-04-30T06:30:10.839ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
124552025-04-30T06:30:10.839ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 564.749457ms iteration = 44 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
124562025-04-30T06:30:10.839ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 45 reason = Signaled
124572025-04-30T06:30:10.839ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
124582025-04-30T06:30:10.840ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
124592025-04-30T06:30:10.840ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
124602025-04-30T06:30:10.840ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
124612025-04-30T06:30:10.842ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
124622025-04-30T06:30:10.864ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124632025-04-30T06:30:10.868ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
124642025-04-30T06:30:10.868ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
124652025-04-30T06:30:10.869ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
124662025-04-30T06:30:10.869ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
124672025-04-30T06:30:10.873ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
124682025-04-30T06:30:10.873ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
124692025-04-30T06:30:10.873ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
124702025-04-30T06:30:10.873ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
124712025-04-30T06:30:10.875ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
124722025-04-30T06:30:10.875ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
124732025-04-30T06:30:10.876ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
124742025-04-30T06:30:10.877ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 58 da 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 X............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:58182 req_id = 73c37f65-3d3c-46de-b1f7-e2d05608415b
124752025-04-30T06:30:10.878ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 22746,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58182 req_id = 73c37f65-3d3c-46de-b1f7-e2d05608415b
124762025-04-30T06:30:10.878ZDEBGtest_image_create (store): query key key = _mgs._tcp
124772025-04-30T06:30:10.881ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
124782025-04-30T06:30:10.881ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:58182 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 73c37f65-3d3c-46de-b1f7-e2d05608415b
124792025-04-30T06:30:10.882ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124802025-04-30T06:30:10.902ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
124812025-04-30T06:30:10.902ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
124822025-04-30T06:30:10.902ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
124832025-04-30T06:30:10.903ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
124842025-04-30T06:30:10.903ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3475, tv_nsec: 702822383 } })
124852025-04-30T06:30:10.904ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
124862025-04-30T06:30:10.906ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ce f1 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51915 req_id = d9c206b1-382f-46bd-826f-b81e3e06ccc1
124872025-04-30T06:30:10.906ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52977,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51915 req_id = d9c206b1-382f-46bd-826f-b81e3e06ccc1
124882025-04-30T06:30:10.906ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
124892025-04-30T06:30:10.907ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51915 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = d9c206b1-382f-46bd-826f-b81e3e06ccc1
124902025-04-30T06:30:10.907ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
124912025-04-30T06:30:10.907ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
124922025-04-30T06:30:10.909ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
124932025-04-30T06:30:11.029ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
124942025-04-30T06:30:11.031ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 81 e6 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:58672 req_id = efe44386-371a-4246-9e02-921422c52f3d
124952025-04-30T06:30:11.031ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 33254,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58672 req_id = efe44386-371a-4246-9e02-921422c52f3d
124962025-04-30T06:30:11.032ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
124972025-04-30T06:30:11.032ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33254, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:58672 req_id = efe44386-371a-4246-9e02-921422c52f3d
124982025-04-30T06:30:11.033ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
124992025-04-30T06:30:11.033ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
125002025-04-30T06:30:11.033ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
125012025-04-30T06:30:11.038ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f9cdcb8-e45e-43e5-8a99-e1e4736cd405", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125022025-04-30T06:30:11.038ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
125032025-04-30T06:30:11.041ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "03186fc8-ed38-4190-94d9-00bb53397dd6", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125042025-04-30T06:30:11.042ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
125052025-04-30T06:30:11.046ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d36b0920-82e8-4855-b4c4-5eeba24a5f0b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125062025-04-30T06:30:11.046ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
125072025-04-30T06:30:11.051ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "77c1298d-45f8-44c7-ba17-40b73ca24524", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125082025-04-30T06:30:11.052ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
125092025-04-30T06:30:11.054ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64397b1f-55bf-414b-bcc8-5bb3293e33f9", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125102025-04-30T06:30:11.055ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
125112025-04-30T06:30:11.057ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "77d5002f-5a97-4426-83a2-3829c80e78ca", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125122025-04-30T06:30:11.058ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
125132025-04-30T06:30:11.060ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aad7e2b-350d-45f7-9f9a-68c2e516ea2b", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125142025-04-30T06:30:11.060ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
125152025-04-30T06:30:11.066ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "81e8bad2-b6dc-4431-b1ef-491b9930b9b3", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125162025-04-30T06:30:11.067ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
125172025-04-30T06:30:11.068ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "159d3f13-4731-4c4b-abf7-813d26605494", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125182025-04-30T06:30:11.069ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
125192025-04-30T06:30:11.085ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "76929729-65f3-4cca-84c3-534608cbe670", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125202025-04-30T06:30:11.085ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
125212025-04-30T06:30:11.086ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
125222025-04-30T06:30:11.089ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "64b05f6e-6653-4e47-9ace-a0e130949ae5", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125232025-04-30T06:30:11.089ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
125242025-04-30T06:30:11.090ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "685ae929-0162-44c8-b288-17c3982da4e6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125252025-04-30T06:30:11.091ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
125262025-04-30T06:30:11.094ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9378f8bc-cd4f-420f-a350-b047811ddde4", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125272025-04-30T06:30:11.094ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
125282025-04-30T06:30:11.100ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7e40230-d1a2-4caa-af43-f6b15ab83b66", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125292025-04-30T06:30:11.100ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
125302025-04-30T06:30:11.104ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3796a42-8c2a-4122-88ea-ea670c380ee5", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125312025-04-30T06:30:11.104ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
125322025-04-30T06:30:11.108ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4323e8c-20db-4b5a-b4f7-b57ac934d66f", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125332025-04-30T06:30:11.108ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
125342025-04-30T06:30:11.111ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bf4c78a-958d-415b-ae87-401607c7a71e", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125352025-04-30T06:30:11.112ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
125362025-04-30T06:30:11.115ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "adf7d77a-40df-45d7-901a-326427387aea", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125372025-04-30T06:30:11.115ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
125382025-04-30T06:30:11.118ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "795010c8-f21a-425e-b4e1-7d26964a8bf4", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125392025-04-30T06:30:11.118ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
125402025-04-30T06:30:11.119ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "25723e32-de36-4892-b4df-f29905a3b54c", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125412025-04-30T06:30:11.120ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
125422025-04-30T06:30:11.121ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "95810a02-2c16-403b-892a-07a54c5b107b", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125432025-04-30T06:30:11.121ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
125442025-04-30T06:30:11.122ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "90f0f4b2-e437-4fd5-8ca4-c26d1394a741", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125452025-04-30T06:30:11.122ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
125462025-04-30T06:30:11.123ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "73259479-b623-4a30-9b3c-4849c5376788", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125472025-04-30T06:30:11.123ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
125482025-04-30T06:30:11.124ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eb40838-ad61-4377-9cf6-d43ee217314b", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125492025-04-30T06:30:11.125ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
125502025-04-30T06:30:11.127ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e0d9767-48bb-47b8-858e-b4dc13edbcf0", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125512025-04-30T06:30:11.127ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
125522025-04-30T06:30:11.129ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "550a9a0f-c078-4cee-b282-9a8decf95150", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125532025-04-30T06:30:11.129ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
125542025-04-30T06:30:11.131ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0599091d-3a48-48d3-bd68-9ccd4a81b772", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125552025-04-30T06:30:11.131ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
125562025-04-30T06:30:11.134ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "17b3a314-94d0-4e01-8464-0bccf3d7b070", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125572025-04-30T06:30:11.134ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
125582025-04-30T06:30:11.137ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "40eb633c-dfa0-4566-a12d-221bd16c98e3", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125592025-04-30T06:30:11.137ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
125602025-04-30T06:30:11.137ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
125612025-04-30T06:30:11.137ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
125622025-04-30T06:30:11.137ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
125632025-04-30T06:30:11.137ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
125642025-04-30T06:30:11.139ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
125652025-04-30T06:30:11.141ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e553bc3-1f7b-459a-8106-b9ce371a7aec", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125662025-04-30T06:30:11.141ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
125672025-04-30T06:30:11.142ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125682025-04-30T06:30:11.150ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
125692025-04-30T06:30:11.150ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
125702025-04-30T06:30:11.150ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
125712025-04-30T06:30:11.151ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
125722025-04-30T06:30:11.152ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f339f0ac-df46-49dd-8bf8-a10ba8899768", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125732025-04-30T06:30:11.153ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
125742025-04-30T06:30:11.153ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
125752025-04-30T06:30:11.153ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
125762025-04-30T06:30:11.154ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
125772025-04-30T06:30:11.156ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "185b1a71-905a-4153-b7c6-7dadd4864a3c", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125782025-04-30T06:30:11.156ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
125792025-04-30T06:30:11.158ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "09c4c816-9a38-4fbf-8a19-31f02bbd0f2b", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125802025-04-30T06:30:11.158ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
125812025-04-30T06:30:11.169ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "45c1e42a-7b7a-4c32-9527-5f4f44214e0b", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125822025-04-30T06:30:11.169ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
125832025-04-30T06:30:11.171ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "21085a5e-e7df-430c-9471-400e09943f66", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125842025-04-30T06:30:11.172ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
125852025-04-30T06:30:11.179ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c650101e-4c32-4ea2-8f94-a15672bd3707", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125862025-04-30T06:30:11.179ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
125872025-04-30T06:30:11.184ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a177248-143a-4362-9afc-4477e203df27", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125882025-04-30T06:30:11.184ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
125892025-04-30T06:30:11.201ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "98179900-2c06-47f6-b64c-0d6f4b9792b0", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125902025-04-30T06:30:11.201ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
125912025-04-30T06:30:11.207ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
125922025-04-30T06:30:11.209ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c655c95e-3054-4f97-a846-a80b265249ae", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125932025-04-30T06:30:11.209ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
125942025-04-30T06:30:11.212ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9774104f-941e-4672-b4de-a8d9a70bfbff", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125952025-04-30T06:30:11.212ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
125962025-04-30T06:30:11.215ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5b33885-39b9-49c6-a4bc-9cfd053a2279", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125972025-04-30T06:30:11.215ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
125982025-04-30T06:30:11.216ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dda6c2c4-6711-4d69-b8a5-a49577864523", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
125992025-04-30T06:30:11.217ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
126002025-04-30T06:30:11.218ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8677e266-f714-4457-b843-db60e6b66bc6", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
126012025-04-30T06:30:11.219ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
126022025-04-30T06:30:11.220ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1a14fca-9254-4b66-8c65-a505d90c8bec", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
126032025-04-30T06:30:11.220ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
126042025-04-30T06:30:11.222ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54bb3125-c8d7-406a-8ae4-fd2c51240994", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
126052025-04-30T06:30:11.222ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
126062025-04-30T06:30:11.222ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
126072025-04-30T06:30:11.222ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
126082025-04-30T06:30:11.222ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
126092025-04-30T06:30:11.223ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
126102025-04-30T06:30:11.227ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126112025-04-30T06:30:11.232ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
126122025-04-30T06:30:11.232ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
126132025-04-30T06:30:11.232ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
126142025-04-30T06:30:11.232ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
126152025-04-30T06:30:11.232ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
126162025-04-30T06:30:11.232ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
126172025-04-30T06:30:11.238ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126182025-04-30T06:30:11.245ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
126192025-04-30T06:30:11.245ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
126202025-04-30T06:30:11.245ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
126212025-04-30T06:30:11.245ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
126222025-04-30T06:30:11.314ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
126232025-04-30T06:30:11.314ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
126242025-04-30T06:30:11.314ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
126252025-04-30T06:30:11.314ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
126262025-04-30T06:30:11.314ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
126272025-04-30T06:30:11.314ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
126282025-04-30T06:30:11.316ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
126292025-04-30T06:30:11.316ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:41794 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
126302025-04-30T06:30:11.316ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
126312025-04-30T06:30:11.317ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
126322025-04-30T06:30:11.318ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 91202639-a2f4-4098-aab7-dedd07c5643e uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
126332025-04-30T06:30:11.318ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:41794 req_id = 6f46db7d-d95d-49ca-bfb4-803000c2ae49 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
126342025-04-30T06:30:11.319ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 91202639-a2f4-4098-aab7-dedd07c5643e resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
126352025-04-30T06:30:11.319ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 91202639-a2f4-4098-aab7-dedd07c5643e roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
126362025-04-30T06:30:11.320ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 91202639-a2f4-4098-aab7-dedd07c5643e resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
126372025-04-30T06:30:11.321ZINFOtest_image_create (dropshot): request completed latency_us = 2753 local_addr = [::1]:42828 method = GET remote_addr = [::1]:41794 req_id = 6f46db7d-d95d-49ca-bfb4-803000c2ae49 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
126382025-04-30T06:30:11.321ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f46db7d-d95d-49ca-bfb4-803000c2ae49", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
126392025-04-30T06:30:11.326ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
126402025-04-30T06:30:11.326ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
126412025-04-30T06:30:11.326ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
126422025-04-30T06:30:11.331ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
126432025-04-30T06:30:11.332ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
126442025-04-30T06:30:11.332ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
126452025-04-30T06:30:11.332ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
126462025-04-30T06:30:11.333ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
126472025-04-30T06:30:11.334ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126482025-04-30T06:30:11.344ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
126492025-04-30T06:30:11.344ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
126502025-04-30T06:30:11.344ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
126512025-04-30T06:30:11.345ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
126522025-04-30T06:30:11.354ZINFOtest_image_create (dropshot_internal): request completed latency_us = 36485 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 91202639-a2f4-4098-aab7-dedd07c5643e response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
126532025-04-30T06:30:11.354ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126542025-04-30T06:30:11.362ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
126552025-04-30T06:30:11.362ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
126562025-04-30T06:30:11.362ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
126572025-04-30T06:30:11.363ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
126582025-04-30T06:30:11.364ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "91202639-a2f4-4098-aab7-dedd07c5643e", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
126592025-04-30T06:30:11.365ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
126602025-04-30T06:30:11.366ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a9b6a54b-a5dd-4863-8e72-940506599210 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
126612025-04-30T06:30:11.372ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a9b6a54b-a5dd-4863-8e72-940506599210 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
126622025-04-30T06:30:11.372ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a9b6a54b-a5dd-4863-8e72-940506599210 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
126632025-04-30T06:30:11.373ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a9b6a54b-a5dd-4863-8e72-940506599210 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
126642025-04-30T06:30:11.375ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
126652025-04-30T06:30:11.375ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
126662025-04-30T06:30:11.375ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
126672025-04-30T06:30:11.377ZINFOtest_image_create (dropshot_internal): request completed latency_us = 11349 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a9b6a54b-a5dd-4863-8e72-940506599210 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
126682025-04-30T06:30:11.378ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9b6a54b-a5dd-4863-8e72-940506599210", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
126692025-04-30T06:30:11.378ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
126702025-04-30T06:30:11.378ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
126712025-04-30T06:30:11.378ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
126722025-04-30T06:30:11.411ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
126732025-04-30T06:30:11.411ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
126742025-04-30T06:30:11.411ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 571.919132ms iteration = 45 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
126752025-04-30T06:30:11.411ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 46 reason = Signaled
126762025-04-30T06:30:11.411ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
126772025-04-30T06:30:11.412ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
126782025-04-30T06:30:11.412ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
126792025-04-30T06:30:11.412ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
126802025-04-30T06:30:11.413ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
126812025-04-30T06:30:11.418ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
126822025-04-30T06:30:11.418ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
126832025-04-30T06:30:11.418ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
126842025-04-30T06:30:11.418ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126852025-04-30T06:30:11.425ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
126862025-04-30T06:30:11.425ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
126872025-04-30T06:30:11.425ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
126882025-04-30T06:30:11.425ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
126892025-04-30T06:30:11.428ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
126902025-04-30T06:30:11.430ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
126912025-04-30T06:30:11.430ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
126922025-04-30T06:30:11.430ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
126932025-04-30T06:30:11.431ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
126942025-04-30T06:30:11.431ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
126952025-04-30T06:30:11.431ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: fb 85 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:63971 req_id = 6fbdfe1a-b90a-4604-8f2f-89e1ec2f36b7
126962025-04-30T06:30:11.431ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64389,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63971 req_id = 6fbdfe1a-b90a-4604-8f2f-89e1ec2f36b7
126972025-04-30T06:30:11.432ZDEBGtest_image_create (store): query key key = _mgs._tcp
126982025-04-30T06:30:11.432ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
126992025-04-30T06:30:11.432ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63971 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 6fbdfe1a-b90a-4604-8f2f-89e1ec2f36b7
127002025-04-30T06:30:11.432ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3476, tv_nsec: 231887891 } })
127012025-04-30T06:30:11.433ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
127022025-04-30T06:30:11.433ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: da 20 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e . ..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:62270 req_id = 3ea66f88-7db0-4ee0-978a-edf04497f678
127032025-04-30T06:30:11.433ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 55840,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62270 req_id = 3ea66f88-7db0-4ee0-978a-edf04497f678
127042025-04-30T06:30:11.433ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
127052025-04-30T06:30:11.433ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62270 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 3ea66f88-7db0-4ee0-978a-edf04497f678
127062025-04-30T06:30:11.515ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
127072025-04-30T06:30:11.516ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
127082025-04-30T06:30:11.516ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
127092025-04-30T06:30:11.516ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
127102025-04-30T06:30:11.516ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
127112025-04-30T06:30:11.517ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
127122025-04-30T06:30:11.518ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
127132025-04-30T06:30:11.518ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
127142025-04-30T06:30:11.519ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
127152025-04-30T06:30:11.520ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
127162025-04-30T06:30:11.521ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: d6 db 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:60270 req_id = e0cfce64-5e2b-46b3-986e-e1825d9ed280
127172025-04-30T06:30:11.522ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 55003,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60270 req_id = e0cfce64-5e2b-46b3-986e-e1825d9ed280
127182025-04-30T06:30:11.522ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
127192025-04-30T06:30:11.523ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55003, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:60270 req_id = e0cfce64-5e2b-46b3-986e-e1825d9ed280
127202025-04-30T06:30:11.524ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127212025-04-30T06:30:11.535ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
127222025-04-30T06:30:11.535ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
127232025-04-30T06:30:11.535ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
127242025-04-30T06:30:11.537ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
127252025-04-30T06:30:11.538ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
127262025-04-30T06:30:11.538ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
127272025-04-30T06:30:11.538ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
127282025-04-30T06:30:11.541ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
127292025-04-30T06:30:11.541ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
127302025-04-30T06:30:11.542ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
127312025-04-30T06:30:11.542ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
127322025-04-30T06:30:11.542ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
127332025-04-30T06:30:11.554ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
127342025-04-30T06:30:11.554ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
127352025-04-30T06:30:11.557ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "38367e81-90e4-4615-bc91-a425be82c291", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127362025-04-30T06:30:11.557ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
127372025-04-30T06:30:11.590ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc6b7791-ca0d-4398-bf5b-a5546c086122", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127382025-04-30T06:30:11.596ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
127392025-04-30T06:30:11.615ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73de857c-56e1-4304-9bba-1a295008796f", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127402025-04-30T06:30:11.615ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
127412025-04-30T06:30:11.617ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ad06f6f-5764-4c2e-8945-0ffce4bb7735", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127422025-04-30T06:30:11.617ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
127432025-04-30T06:30:11.620ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
127442025-04-30T06:30:11.638ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e78024d-bb88-48e0-b923-24837a0a7466", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127452025-04-30T06:30:11.638ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
127462025-04-30T06:30:11.643ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
127472025-04-30T06:30:11.672ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d3871ab-3f6b-4e4f-b3e7-52c2ce0a43db", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127482025-04-30T06:30:11.673ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
127492025-04-30T06:30:11.674ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e542bc7-6b64-4356-9a38-cbef87b97a56", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127502025-04-30T06:30:11.675ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
127512025-04-30T06:30:11.676ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bc74abf-db5b-4d50-a75a-43e9f0271ed3", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127522025-04-30T06:30:11.676ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
127532025-04-30T06:30:11.677ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c5bd506-e39b-49ae-9ad3-96d9721b626d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127542025-04-30T06:30:11.677ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
127552025-04-30T06:30:11.678ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "62338a5e-e00e-4a8a-82f9-bb44d817ac07", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127562025-04-30T06:30:11.678ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
127572025-04-30T06:30:11.680ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad8a1ab-a514-4b67-9a11-454dbd06d864", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127582025-04-30T06:30:11.680ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
127592025-04-30T06:30:11.682ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e48fb0b-b523-4be5-84c5-de7b7449af45", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127602025-04-30T06:30:11.682ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
127612025-04-30T06:30:11.684ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "55aa71fd-b0ac-469b-8c3c-26b39723ceb4", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127622025-04-30T06:30:11.684ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
127632025-04-30T06:30:11.686ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5809a53-1f9b-4b0e-a060-91484823561e", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127642025-04-30T06:30:11.686ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
127652025-04-30T06:30:11.689ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "43536fe7-1253-4ca6-926c-a20c3b060d40", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127662025-04-30T06:30:11.689ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
127672025-04-30T06:30:11.694ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1a744eb-2b5b-45ed-8d3f-326c5391ef53", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127682025-04-30T06:30:11.695ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
127692025-04-30T06:30:11.695ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
127702025-04-30T06:30:11.695ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
127712025-04-30T06:30:11.695ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
127722025-04-30T06:30:11.695ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
127732025-04-30T06:30:11.696ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
127742025-04-30T06:30:11.699ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127752025-04-30T06:30:11.709ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
127762025-04-30T06:30:11.709ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
127772025-04-30T06:30:11.709ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
127782025-04-30T06:30:11.712ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
127792025-04-30T06:30:11.714ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "436fa70f-bdf9-4e59-ae93-a28c7ceee820", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127802025-04-30T06:30:11.714ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
127812025-04-30T06:30:11.714ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
127822025-04-30T06:30:11.714ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
127832025-04-30T06:30:11.715ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
127842025-04-30T06:30:11.717ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f40c30a1-3ea9-429c-a6fc-745bf09290d9", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127852025-04-30T06:30:11.717ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
127862025-04-30T06:30:11.720ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "06a43560-4357-495f-b0e8-3c6fafeff02f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127872025-04-30T06:30:11.720ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
127882025-04-30T06:30:11.722ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b011a6d-eb89-4f91-ba95-744535acac59", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127892025-04-30T06:30:11.722ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
127902025-04-30T06:30:11.723ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c980445-a9ff-4e51-9c29-377e19fbd4d4", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127912025-04-30T06:30:11.723ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
127922025-04-30T06:30:11.724ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40c89347-56fb-4e0d-aa92-ff356bca83a8", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127932025-04-30T06:30:11.724ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
127942025-04-30T06:30:11.727ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "adbbf470-eba3-44a4-b907-1c78add554cf", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127952025-04-30T06:30:11.728ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
127962025-04-30T06:30:11.734ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5613346-5f80-4318-8041-50a84490b550", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127972025-04-30T06:30:11.734ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
127982025-04-30T06:30:11.744ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de749a7-1b73-40e1-b6bc-79daed20dacf", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:10 GMT"} })
127992025-04-30T06:30:11.744ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
128002025-04-30T06:30:11.750ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
128012025-04-30T06:30:11.753ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4471701c-df11-4091-880f-c5e5c3073643", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128022025-04-30T06:30:11.753ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
128032025-04-30T06:30:11.767ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "092850e5-ee74-427f-8413-80f1ee5cd424", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128042025-04-30T06:30:11.770ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
128052025-04-30T06:30:11.775ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9833f0ed-f485-49b3-8f79-a886f1fc9e9b", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128062025-04-30T06:30:11.776ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
128072025-04-30T06:30:11.779ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "24f8df1e-5d9e-415b-a018-529db9a75401", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128082025-04-30T06:30:11.780ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
128092025-04-30T06:30:11.784ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a94a6521-fd55-41ed-969b-338a1ee0722d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128102025-04-30T06:30:11.784ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
128112025-04-30T06:30:11.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd1aab7f-bf5d-4c80-8593-28879f97f966", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128122025-04-30T06:30:11.787ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
128132025-04-30T06:30:11.789ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb7b79a8-d02d-4106-81f1-8e0cd689fd75", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128142025-04-30T06:30:11.789ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
128152025-04-30T06:30:11.791ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2fccaf0-046c-41a5-8b75-2c1ca7d22ce2", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128162025-04-30T06:30:11.791ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
128172025-04-30T06:30:11.793ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "75f20608-9fe9-49bd-9d69-14fa9cd646e6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128182025-04-30T06:30:11.794ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
128192025-04-30T06:30:11.795ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba28d40c-6daa-4d0b-ac6a-f6a21418ed58", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128202025-04-30T06:30:11.797ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
128212025-04-30T06:30:11.798ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
128222025-04-30T06:30:11.799ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: e0 3e 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .>..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:56569 req_id = 415e8249-c81f-474d-8dc2-cf620d1d3f34
128232025-04-30T06:30:11.799ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 57406,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:56569 req_id = 415e8249-c81f-474d-8dc2-cf620d1d3f34
128242025-04-30T06:30:11.800ZDEBGtest_image_create (store): query key key = _dendrite._tcp
128252025-04-30T06:30:11.800ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
128262025-04-30T06:30:11.800ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:56569 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 415e8249-c81f-474d-8dc2-cf620d1d3f34
128272025-04-30T06:30:11.801ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3476, tv_nsec: 599868408 } })
128282025-04-30T06:30:11.801ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
128292025-04-30T06:30:11.802ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
128302025-04-30T06:30:11.802ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
128312025-04-30T06:30:11.802ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
128322025-04-30T06:30:11.802ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
128332025-04-30T06:30:11.803ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
128342025-04-30T06:30:11.804ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 64 a9 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e d...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:54386 req_id = 15db2d56-8049-4b2f-9a23-28363538eaa9
128352025-04-30T06:30:11.804ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25769,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54386 req_id = 15db2d56-8049-4b2f-9a23-28363538eaa9
128362025-04-30T06:30:11.805ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
128372025-04-30T06:30:11.805ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:54386 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 15db2d56-8049-4b2f-9a23-28363538eaa9
128382025-04-30T06:30:11.806ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector
128392025-04-30T06:30:11.907ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector zone_address = ::1
128402025-04-30T06:30:11.907ZDEBGtest_image_create (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[::1]:12225/local/switch-id
128412025-04-30T06:30:11.907ZDEBGtest_image_create (MgsClient): client response background_task = nat_v4_garbage_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
128422025-04-30T06:30:11.907ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = nat_v4_garbage_collector reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
128432025-04-30T06:30:11.910ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = nat_v4_garbage_collector
128442025-04-30T06:30:11.910ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128452025-04-30T06:30:11.919ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
128462025-04-30T06:30:11.919ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
128472025-04-30T06:30:11.919ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
128482025-04-30T06:30:11.920ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
128492025-04-30T06:30:11.923ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
128502025-04-30T06:30:11.923ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
128512025-04-30T06:30:11.923ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
128522025-04-30T06:30:11.923ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8027c57-400e-4b09-bbb9-4911e3182708", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128532025-04-30T06:30:11.923ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
128542025-04-30T06:30:11.927ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8698ec4f-4e5f-4b1f-a2f3-aa60de031456", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128552025-04-30T06:30:11.927ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
128562025-04-30T06:30:11.932ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "423e728d-1dde-4ce9-b09c-7b75383dcd98", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128572025-04-30T06:30:11.932ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
128582025-04-30T06:30:11.935ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1e7299b-ff54-44a9-ae27-6f45f8900ba7", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128592025-04-30T06:30:11.936ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
128602025-04-30T06:30:11.938ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
128612025-04-30T06:30:11.939ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: e1 f5 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:60135 req_id = c1dbc500-6e5f-4dae-9001-4c9a819595b8
128622025-04-30T06:30:11.939ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 57845,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60135 req_id = c1dbc500-6e5f-4dae-9001-4c9a819595b8
128632025-04-30T06:30:11.939ZDEBGtest_image_create (store): query key key = _dendrite._tcp
128642025-04-30T06:30:11.939ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
128652025-04-30T06:30:11.939ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:60135 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = c1dbc500-6e5f-4dae-9001-4c9a819595b8
128662025-04-30T06:30:11.941ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3476, tv_nsec: 740750316 } })
128672025-04-30T06:30:11.941ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
128682025-04-30T06:30:11.942ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 9f b4 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:50220 req_id = 578b15ea-9619-443e-9b88-5415a1aca6ac
128692025-04-30T06:30:11.942ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 40884,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50220 req_id = 578b15ea-9619-443e-9b88-5415a1aca6ac
128702025-04-30T06:30:11.942ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
128712025-04-30T06:30:11.942ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:50220 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 578b15ea-9619-443e-9b88-5415a1aca6ac
128722025-04-30T06:30:11.943ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager
128732025-04-30T06:30:12.017ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager zone_address = ::1
128742025-04-30T06:30:12.028ZDEBGtest_image_create (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[::1]:12225/local/switch-id
128752025-04-30T06:30:12.029ZDEBGtest_image_create (MgsClient): client response background_task = bfd_manager result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
128762025-04-30T06:30:12.029ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = bfd_manager reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
128772025-04-30T06:30:12.031ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = bfd_manager
128782025-04-30T06:30:12.033ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0a6fa84-3077-4be2-a3b3-e872c9f39e69", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128792025-04-30T06:30:12.034ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
128802025-04-30T06:30:12.042ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "622def76-d933-4c03-972e-af4b8369f578", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128812025-04-30T06:30:12.042ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
128822025-04-30T06:30:12.043ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "26c108f1-55ba-4fcb-ae3a-e5b0db7b4c5a", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128832025-04-30T06:30:12.043ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
128842025-04-30T06:30:12.048ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2138fc39-0a12-4b6b-b5c2-344ccf7fbd12", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128852025-04-30T06:30:12.048ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
128862025-04-30T06:30:12.049ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
128872025-04-30T06:30:12.052ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c3104ff-1f0c-42ce-902b-78ee3003c967", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128882025-04-30T06:30:12.053ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
128892025-04-30T06:30:12.056ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49ef6434-be91-432b-88aa-fe2fa2bd5d90", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
128902025-04-30T06:30:12.056ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
128912025-04-30T06:30:12.056ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
128922025-04-30T06:30:12.057ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
128932025-04-30T06:30:12.057ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
128942025-04-30T06:30:12.058ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
128952025-04-30T06:30:12.063ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
128962025-04-30T06:30:12.064ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128972025-04-30T06:30:12.073ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
128982025-04-30T06:30:12.073ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
128992025-04-30T06:30:12.073ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
129002025-04-30T06:30:12.073ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
129012025-04-30T06:30:12.074ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
129022025-04-30T06:30:12.075ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
129032025-04-30T06:30:12.078ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129042025-04-30T06:30:12.089ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
129052025-04-30T06:30:12.089ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
129062025-04-30T06:30:12.090ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
129072025-04-30T06:30:12.092ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
129082025-04-30T06:30:12.093ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: c8 ed 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:63718 req_id = 4ce8039f-9545-4601-a072-a41c5b8f9306
129092025-04-30T06:30:12.093ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 51437,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:63718 req_id = 4ce8039f-9545-4601-a072-a41c5b8f9306
129102025-04-30T06:30:12.093ZDEBGtest_image_create (store): query key key = _dendrite._tcp
129112025-04-30T06:30:12.101ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
129122025-04-30T06:30:12.101ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:63718 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 4ce8039f-9545-4601-a072-a41c5b8f9306
129132025-04-30T06:30:12.101ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
129142025-04-30T06:30:12.102ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
129152025-04-30T06:30:12.102ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
129162025-04-30T06:30:12.102ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
129172025-04-30T06:30:12.102ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
129182025-04-30T06:30:12.103ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3476, tv_nsec: 902013783 } })
129192025-04-30T06:30:12.103ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
129202025-04-30T06:30:12.174ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
129212025-04-30T06:30:12.174ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
129222025-04-30T06:30:12.174ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:38763 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
129232025-04-30T06:30:12.182ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129242025-04-30T06:30:12.190ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
129252025-04-30T06:30:12.190ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
129262025-04-30T06:30:12.190ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
129272025-04-30T06:30:12.191ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
129282025-04-30T06:30:12.191ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:38763 req_id = fe4c73a3-02a6-4e08-a39a-499c03509b91 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
129292025-04-30T06:30:12.191ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 89 4e 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .N..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:55656 req_id = a5748628-0d63-4b92-b38e-fce8a7c6ca74
129302025-04-30T06:30:12.191ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 35150,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55656 req_id = a5748628-0d63-4b92-b38e-fce8a7c6ca74
129312025-04-30T06:30:12.191ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
129322025-04-30T06:30:12.192ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:55656 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = a5748628-0d63-4b92-b38e-fce8a7c6ca74
129332025-04-30T06:30:12.193ZINFOtest_image_create (dropshot): request completed latency_us = 2433 local_addr = [::1]:42828 method = GET remote_addr = [::1]:38763 req_id = fe4c73a3-02a6-4e08-a39a-499c03509b91 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
129342025-04-30T06:30:12.195ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
129352025-04-30T06:30:12.260ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc zone_address = ::1
129362025-04-30T06:30:12.260ZDEBGtest_image_create (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc uri = http://[::1]:12225/local/switch-id
129372025-04-30T06:30:12.260ZDEBGtest_image_create (MgsClient): client response background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
129382025-04-30T06:30:12.260ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
129392025-04-30T06:30:12.261ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
129402025-04-30T06:30:12.261ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe4c73a3-02a6-4e08-a39a-499c03509b91", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
129412025-04-30T06:30:12.269ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
129422025-04-30T06:30:12.269ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
129432025-04-30T06:30:12.269ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
129442025-04-30T06:30:12.269ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
129452025-04-30T06:30:12.269ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
129462025-04-30T06:30:12.269ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
129472025-04-30T06:30:12.269ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
129482025-04-30T06:30:12.269ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
129492025-04-30T06:30:12.270ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129502025-04-30T06:30:12.274ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
129512025-04-30T06:30:12.275ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
129522025-04-30T06:30:12.275ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
129532025-04-30T06:30:12.275ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
129542025-04-30T06:30:12.275ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
129552025-04-30T06:30:12.276ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
129562025-04-30T06:30:12.276ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
129572025-04-30T06:30:12.315ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
129582025-04-30T06:30:12.319ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
129592025-04-30T06:30:12.320ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
129602025-04-30T06:30:12.320ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 907.862447ms iteration = 46 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
129612025-04-30T06:30:12.320ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 47 reason = Signaled
129622025-04-30T06:30:12.320ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
129632025-04-30T06:30:12.320ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
129642025-04-30T06:30:12.321ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
129652025-04-30T06:30:12.321ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
129662025-04-30T06:30:12.321ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
129672025-04-30T06:30:12.324ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129682025-04-30T06:30:12.330ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
129692025-04-30T06:30:12.330ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
129702025-04-30T06:30:12.330ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
129712025-04-30T06:30:12.332ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
129722025-04-30T06:30:12.335ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
129732025-04-30T06:30:12.335ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
129742025-04-30T06:30:12.337ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: d1 e2 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:64692 req_id = 925f42f3-c1e3-4e4a-8e9f-c04fa34aab36
129752025-04-30T06:30:12.337ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 53730,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64692 req_id = 925f42f3-c1e3-4e4a-8e9f-c04fa34aab36
129762025-04-30T06:30:12.337ZDEBGtest_image_create (store): query key key = _mgs._tcp
129772025-04-30T06:30:12.337ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
129782025-04-30T06:30:12.338ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:64692 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 925f42f3-c1e3-4e4a-8e9f-c04fa34aab36
129792025-04-30T06:30:12.338ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3477, tv_nsec: 137511216 } })
129802025-04-30T06:30:12.338ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
129812025-04-30T06:30:12.339ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 2e 4b 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .K..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:65212 req_id = 6b06da30-1477-4cf7-a3e0-46a6f1acf0c5
129822025-04-30T06:30:12.339ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 11851,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:65212 req_id = 6b06da30-1477-4cf7-a3e0-46a6f1acf0c5
129832025-04-30T06:30:12.339ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
129842025-04-30T06:30:12.339ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:65212 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 6b06da30-1477-4cf7-a3e0-46a6f1acf0c5
129852025-04-30T06:30:12.395ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
129862025-04-30T06:30:12.395ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
129872025-04-30T06:30:12.395ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
129882025-04-30T06:30:12.395ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
129892025-04-30T06:30:12.395ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
129902025-04-30T06:30:12.397ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
129912025-04-30T06:30:12.397ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: b1 e0 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:50961 req_id = 2a1fb194-15c4-4760-a2d0-19bc8280662a
129922025-04-30T06:30:12.397ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45536,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:50961 req_id = 2a1fb194-15c4-4760-a2d0-19bc8280662a
129932025-04-30T06:30:12.398ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
129942025-04-30T06:30:12.398ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45536, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:50961 req_id = 2a1fb194-15c4-4760-a2d0-19bc8280662a
129952025-04-30T06:30:12.398ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
129962025-04-30T06:30:12.398ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
129972025-04-30T06:30:12.398ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
129982025-04-30T06:30:12.399ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129992025-04-30T06:30:12.412ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
130002025-04-30T06:30:12.412ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
130012025-04-30T06:30:12.412ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
130022025-04-30T06:30:12.414ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
130032025-04-30T06:30:12.421ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
130042025-04-30T06:30:12.421ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaef0ef0-66eb-4986-9f14-6f6d8bc54725", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130052025-04-30T06:30:12.421ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
130062025-04-30T06:30:12.422ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
130072025-04-30T06:30:12.422ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
130082025-04-30T06:30:12.422ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
130092025-04-30T06:30:12.423ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
130102025-04-30T06:30:12.434ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
130112025-04-30T06:30:12.436ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
130122025-04-30T06:30:12.436ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
130132025-04-30T06:30:12.437ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
130142025-04-30T06:30:12.438ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e38c600-aa4c-43bd-9a4e-f50aff323a88", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130152025-04-30T06:30:12.438ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
130162025-04-30T06:30:12.443ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b8e7966-77bc-467e-9cf1-2ec9226f8a89", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130172025-04-30T06:30:12.447ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
130182025-04-30T06:30:12.451ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "31c471ee-4a4e-44d8-a242-124e6f915c46", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130192025-04-30T06:30:12.451ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
130202025-04-30T06:30:12.453ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "702bb318-be61-427d-bfa8-0cee808d71b8", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130212025-04-30T06:30:12.454ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
130222025-04-30T06:30:12.457ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa3d44dc-7927-49df-a355-b3dd8c8e7c81", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130232025-04-30T06:30:12.457ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
130242025-04-30T06:30:12.459ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "15cebcf3-8eac-4696-9074-5dad2d67dc36", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130252025-04-30T06:30:12.459ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
130262025-04-30T06:30:12.462ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecc1f2c9-492a-48f6-bec9-3e50dde2e051", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130272025-04-30T06:30:12.462ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
130282025-04-30T06:30:12.463ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fad72d3-e72f-4a86-a1a1-d5b3a076c8e8", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130292025-04-30T06:30:12.463ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
130302025-04-30T06:30:12.464ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3b07d36-1927-43d3-b5e2-de05446ebe27", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130312025-04-30T06:30:12.465ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
130322025-04-30T06:30:12.466ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fa85908-10cc-465c-b724-f9386adfb3bd", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130332025-04-30T06:30:12.466ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
130342025-04-30T06:30:12.469ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "48413008-9138-4c6b-96b6-decfc0121366", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130352025-04-30T06:30:12.470ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
130362025-04-30T06:30:12.470ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
130372025-04-30T06:30:12.475ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "39b64245-d665-47b3-b584-4dd10a6e97d5", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130382025-04-30T06:30:12.476ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
130392025-04-30T06:30:12.481ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c56e319-37b8-4ddd-ae56-ba9d12acc319", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130402025-04-30T06:30:12.481ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
130412025-04-30T06:30:12.512ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a3bcee0-f4ae-45d4-91e2-c8fdcdfa0103", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130422025-04-30T06:30:12.513ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
130432025-04-30T06:30:12.514ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
130442025-04-30T06:30:12.514ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
130452025-04-30T06:30:12.514ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
130462025-04-30T06:30:12.515ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
130472025-04-30T06:30:12.521ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
130482025-04-30T06:30:12.524ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
130492025-04-30T06:30:12.524ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
130502025-04-30T06:30:12.524ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
130512025-04-30T06:30:12.525ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
130522025-04-30T06:30:12.530ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
130532025-04-30T06:30:12.530ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
130542025-04-30T06:30:12.535ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130552025-04-30T06:30:12.541ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
130562025-04-30T06:30:12.541ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
130572025-04-30T06:30:12.541ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
130582025-04-30T06:30:12.541ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
130592025-04-30T06:30:12.544ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
130602025-04-30T06:30:12.544ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
130612025-04-30T06:30:12.545ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d33d3e69-09be-4eb1-ba80-2287c0cf88d0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130622025-04-30T06:30:12.545ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
130632025-04-30T06:30:12.547ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
130642025-04-30T06:30:12.548ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
130652025-04-30T06:30:12.548ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
130662025-04-30T06:30:12.550ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "88e2ede9-9775-492e-b8a5-872ac9a93fa0", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130672025-04-30T06:30:12.551ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
130682025-04-30T06:30:12.558ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecc28188-7b33-4b09-897d-13acab54d775", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130692025-04-30T06:30:12.558ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
130702025-04-30T06:30:12.562ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a92f9251-8349-4c87-b564-0da11c9790d2", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130712025-04-30T06:30:12.562ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
130722025-04-30T06:30:12.563ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "252b4029-9d5f-4d7c-99d2-ee637d1eaa4e", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130732025-04-30T06:30:12.563ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
130742025-04-30T06:30:12.565ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecb30d20-22ca-4297-8586-81584a90c567", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130752025-04-30T06:30:12.565ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
130762025-04-30T06:30:12.567ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dec9370-4648-4c51-bd99-8904c1bc8f3b", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130772025-04-30T06:30:12.567ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
130782025-04-30T06:30:12.569ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7edf10a7-ac93-4a8a-9ff0-337a1c9b06f3", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130792025-04-30T06:30:12.570ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
130802025-04-30T06:30:12.573ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5bd3fad-e585-4d57-8b28-5ed5de80275d", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130812025-04-30T06:30:12.573ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
130822025-04-30T06:30:12.577ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1c9b97f-46f1-4c47-8437-6c9ec381ded6", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130832025-04-30T06:30:12.578ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
130842025-04-30T06:30:12.588ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4d3882d-788a-406d-9a10-d3d4cbeb3b4b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130852025-04-30T06:30:12.588ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
130862025-04-30T06:30:12.588ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
130872025-04-30T06:30:12.592ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30e43dcb-73f1-4227-9807-76a89bcb41a2", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130882025-04-30T06:30:12.592ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
130892025-04-30T06:30:12.595ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "41e538f0-f642-42f2-ba82-7eb641b78be1", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130902025-04-30T06:30:12.595ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
130912025-04-30T06:30:12.597ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6a398f2-d8ff-4ca3-a385-a33a35169fcb", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130922025-04-30T06:30:12.597ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
130932025-04-30T06:30:12.598ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c8a34d3-44bf-4d77-b856-6508b15cbb3c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130942025-04-30T06:30:12.598ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
130952025-04-30T06:30:12.599ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "255c7264-187b-4eea-bff0-f9eb86498479", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130962025-04-30T06:30:12.599ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
130972025-04-30T06:30:12.600ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "44f65992-30aa-483a-a08a-fb70fdaf8ed0", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
130982025-04-30T06:30:12.600ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
130992025-04-30T06:30:12.602ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "859ee2f3-65ae-4763-8263-6e3e33a07bfc", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131002025-04-30T06:30:12.602ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
131012025-04-30T06:30:12.603ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e80ebf3-4639-4cef-b311-aa0bcf605a0c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131022025-04-30T06:30:12.603ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
131032025-04-30T06:30:12.605ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b9d849c-4c55-4720-a298-549ab3725966", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131042025-04-30T06:30:12.605ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
131052025-04-30T06:30:12.607ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fb14b29-0da2-4118-836e-1cb8bc4fdd6f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131062025-04-30T06:30:12.607ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
131072025-04-30T06:30:12.609ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c632912d-5e2a-40bd-8486-4f8e7c5ca30d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131082025-04-30T06:30:12.609ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
131092025-04-30T06:30:12.619ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9cfae64-f30e-4328-b5cf-c3da19bfa855", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131102025-04-30T06:30:12.619ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
131112025-04-30T06:30:12.619ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
131122025-04-30T06:30:12.622ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b88a674c-a39a-487f-9be3-90ff1eb0de4e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131132025-04-30T06:30:12.622ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
131142025-04-30T06:30:12.623ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0aef173-9b03-43c3-b470-b30b1d82cf53", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131152025-04-30T06:30:12.623ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
131162025-04-30T06:30:12.625ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1acc53b-5e31-4d58-8453-ee45baf02435", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131172025-04-30T06:30:12.625ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
131182025-04-30T06:30:12.626ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "da470dc9-789d-4da4-8d6a-a61f5e790ca6", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131192025-04-30T06:30:12.626ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
131202025-04-30T06:30:12.628ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "19f6c70f-68b0-40a1-bac9-6f2de348ddda", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131212025-04-30T06:30:12.628ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
131222025-04-30T06:30:12.629ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4397316-86db-490e-8c65-71faf4785018", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131232025-04-30T06:30:12.630ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
131242025-04-30T06:30:12.631ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eef60dc8-f403-4f07-bdd0-f95532184994", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131252025-04-30T06:30:12.632ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
131262025-04-30T06:30:12.632ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
131272025-04-30T06:30:12.632ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
131282025-04-30T06:30:12.632ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
131292025-04-30T06:30:12.633ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
131302025-04-30T06:30:12.639ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
131312025-04-30T06:30:12.639ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
131322025-04-30T06:30:12.639ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
131332025-04-30T06:30:12.639ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
131342025-04-30T06:30:12.648ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
131352025-04-30T06:30:12.648ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131362025-04-30T06:30:12.653ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
131372025-04-30T06:30:12.653ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
131382025-04-30T06:30:12.653ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
131392025-04-30T06:30:12.653ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
131402025-04-30T06:30:12.653ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
131412025-04-30T06:30:12.654ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
131422025-04-30T06:30:12.655ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131432025-04-30T06:30:12.672ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
131442025-04-30T06:30:12.672ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
131452025-04-30T06:30:12.672ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
131462025-04-30T06:30:12.673ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
131472025-04-30T06:30:12.673ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131482025-04-30T06:30:12.679ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
131492025-04-30T06:30:12.679ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
131502025-04-30T06:30:12.679ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
131512025-04-30T06:30:12.681ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
131522025-04-30T06:30:12.683ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
131532025-04-30T06:30:12.683ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
131542025-04-30T06:30:12.684ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
131552025-04-30T06:30:12.750ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
131562025-04-30T06:30:12.750ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
131572025-04-30T06:30:12.751ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:53747 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
131582025-04-30T06:30:12.752ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:53747 req_id = c568de46-6f22-474b-b1ce-d1b49cf48b95 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
131592025-04-30T06:30:12.754ZINFOtest_image_create (dropshot): request completed latency_us = 671 local_addr = [::1]:42828 method = GET remote_addr = [::1]:53747 req_id = c568de46-6f22-474b-b1ce-d1b49cf48b95 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
131602025-04-30T06:30:12.755ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "c568de46-6f22-474b-b1ce-d1b49cf48b95", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:11 GMT"} })
131612025-04-30T06:30:12.766ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
131622025-04-30T06:30:12.766ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
131632025-04-30T06:30:12.766ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
131642025-04-30T06:30:12.766ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
131652025-04-30T06:30:12.766ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
131662025-04-30T06:30:12.766ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
131672025-04-30T06:30:12.766ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
131682025-04-30T06:30:12.766ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
131692025-04-30T06:30:12.767ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131702025-04-30T06:30:12.778ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
131712025-04-30T06:30:12.778ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
131722025-04-30T06:30:12.778ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
131732025-04-30T06:30:12.779ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
131742025-04-30T06:30:12.815ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
131752025-04-30T06:30:12.824ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
131762025-04-30T06:30:12.825ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
131772025-04-30T06:30:12.825ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 505.470256ms iteration = 47 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
131782025-04-30T06:30:12.825ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 48 reason = Signaled
131792025-04-30T06:30:12.825ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
131802025-04-30T06:30:12.825ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
131812025-04-30T06:30:12.825ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
131822025-04-30T06:30:12.825ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
131832025-04-30T06:30:12.826ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
131842025-04-30T06:30:12.831ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131852025-04-30T06:30:12.837ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
131862025-04-30T06:30:12.837ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
131872025-04-30T06:30:12.837ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
131882025-04-30T06:30:12.838ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
131892025-04-30T06:30:12.843ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
131902025-04-30T06:30:12.843ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
131912025-04-30T06:30:12.845ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: dc 97 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:52195 req_id = 9c7a75e4-6404-4469-a2c0-38ccbc585a23
131922025-04-30T06:30:12.845ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56471,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:52195 req_id = 9c7a75e4-6404-4469-a2c0-38ccbc585a23
131932025-04-30T06:30:12.845ZDEBGtest_image_create (store): query key key = _mgs._tcp
131942025-04-30T06:30:12.845ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
131952025-04-30T06:30:12.846ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:52195 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 9c7a75e4-6404-4469-a2c0-38ccbc585a23
131962025-04-30T06:30:12.846ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3477, tv_nsec: 645500110 } })
131972025-04-30T06:30:12.846ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
131982025-04-30T06:30:12.847ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 9f d3 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:59520 req_id = ab25e6b1-f6b3-4f73-85b0-d739981c181c
131992025-04-30T06:30:12.847ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 40915,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59520 req_id = ab25e6b1-f6b3-4f73-85b0-d739981c181c
132002025-04-30T06:30:12.847ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
132012025-04-30T06:30:12.847ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59520 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = ab25e6b1-f6b3-4f73-85b0-d739981c181c
132022025-04-30T06:30:12.930ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
132032025-04-30T06:30:12.938ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
132042025-04-30T06:30:12.938ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
132052025-04-30T06:30:12.938ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
132062025-04-30T06:30:12.938ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
132072025-04-30T06:30:12.940ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
132082025-04-30T06:30:12.940ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 53 66 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c Sf..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:62214 req_id = 72c07ce0-77d3-4cae-a1e2-546ce5e6fb55
132092025-04-30T06:30:12.940ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 21350,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:62214 req_id = 72c07ce0-77d3-4cae-a1e2-546ce5e6fb55
132102025-04-30T06:30:12.940ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
132112025-04-30T06:30:12.941ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21350, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:62214 req_id = 72c07ce0-77d3-4cae-a1e2-546ce5e6fb55
132122025-04-30T06:30:12.945ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
132132025-04-30T06:30:12.945ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
132142025-04-30T06:30:12.945ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
132152025-04-30T06:30:12.945ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132162025-04-30T06:30:12.951ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
132172025-04-30T06:30:12.951ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
132182025-04-30T06:30:12.951ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
132192025-04-30T06:30:12.952ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
132202025-04-30T06:30:12.955ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "97e093d8-2e05-44ae-a7e0-f152b4764b7e", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132212025-04-30T06:30:12.956ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
132222025-04-30T06:30:12.956ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
132232025-04-30T06:30:12.956ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
132242025-04-30T06:30:12.957ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
132252025-04-30T06:30:12.960ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "486d9f55-a314-4734-956f-9ec606eccf97", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132262025-04-30T06:30:12.962ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
132272025-04-30T06:30:12.965ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "074a4ec3-3912-4c6c-b84f-93678c03620c", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132282025-04-30T06:30:12.968ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
132292025-04-30T06:30:12.972ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "348be954-a6f6-4c9f-8586-3f3385ad8a9a", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132302025-04-30T06:30:12.973ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
132312025-04-30T06:30:12.975ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "17cd5c2c-805e-4e83-aacf-b97d57ccdb48", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132322025-04-30T06:30:12.976ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
132332025-04-30T06:30:12.979ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "60d3ca96-385e-47a6-8355-39907937aee3", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132342025-04-30T06:30:12.980ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
132352025-04-30T06:30:12.985ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "94a05abc-9151-456a-a0f5-b57b2c097d13", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132362025-04-30T06:30:12.985ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
132372025-04-30T06:30:12.988ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "154afedf-f81e-43bf-84c4-247e83624852", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132382025-04-30T06:30:12.989ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
132392025-04-30T06:30:12.990ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "11f3e293-d655-4cdb-ba8e-b7041b621945", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132402025-04-30T06:30:12.990ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
132412025-04-30T06:30:12.994ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b332cf3b-b55a-4089-b903-a2e46c490718", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132422025-04-30T06:30:12.995ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
132432025-04-30T06:30:13.002ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
132442025-04-30T06:30:13.004ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "08c2a998-7bd2-4e45-9a3a-4721bd47a617", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132452025-04-30T06:30:13.004ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
132462025-04-30T06:30:13.006ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "284df78c-7d57-43a4-972b-fcfb7d796077", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132472025-04-30T06:30:13.007ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
132482025-04-30T06:30:13.009ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "73de6e74-e59e-4321-9181-af52dcbf5f0d", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132492025-04-30T06:30:13.009ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
132502025-04-30T06:30:13.011ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "268d5c8d-3d88-49dc-967c-44b931999c29", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132512025-04-30T06:30:13.011ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
132522025-04-30T06:30:13.014ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "577f0df3-5ba7-4230-8b90-dd0738494fba", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132532025-04-30T06:30:13.015ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
132542025-04-30T06:30:13.020ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "be96397a-fc0f-48d8-84f8-291f7ff4ceef", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132552025-04-30T06:30:13.021ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
132562025-04-30T06:30:13.024ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eb05ef3-b027-4c92-b213-4fc5dbe3274c", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132572025-04-30T06:30:13.024ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
132582025-04-30T06:30:13.027ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e0bbe72-ee05-4cb9-960d-06d7f361f21a", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132592025-04-30T06:30:13.027ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
132602025-04-30T06:30:13.030ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d7736ee-ce55-4a0e-a22a-b2a7a36fbdee", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132612025-04-30T06:30:13.030ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
132622025-04-30T06:30:13.031ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a20c75a-2a62-4143-90d4-c66f5b5611ec", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132632025-04-30T06:30:13.031ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
132642025-04-30T06:30:13.033ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2904bea1-adff-40e2-a3d9-e8aeac98252e", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132652025-04-30T06:30:13.033ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
132662025-04-30T06:30:13.034ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "011bfe2d-c4bc-458f-96a7-a46f51a0f111", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132672025-04-30T06:30:13.035ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
132682025-04-30T06:30:13.037ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "256c35b6-8e9c-4a1f-aa1d-c935e4b0978c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132692025-04-30T06:30:13.037ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
132702025-04-30T06:30:13.040ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4ff2c52-e1a4-4963-8441-18c7b957cd58", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132712025-04-30T06:30:13.040ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
132722025-04-30T06:30:13.044ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8f4c62c-a93f-48d4-918d-eda0c3c3deaf", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132732025-04-30T06:30:13.044ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
132742025-04-30T06:30:13.047ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "76a8efb9-172a-4460-93d1-ae9e1bef30cc", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132752025-04-30T06:30:13.047ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
132762025-04-30T06:30:13.050ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d6f67b2-ccc9-4386-9ecd-94fa62a0765e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132772025-04-30T06:30:13.050ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
132782025-04-30T06:30:13.052ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa96ea32-3090-4a13-8582-679043b1ce7d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132792025-04-30T06:30:13.052ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
132802025-04-30T06:30:13.053ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
132812025-04-30T06:30:13.053ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
132822025-04-30T06:30:13.053ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
132832025-04-30T06:30:13.053ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
132842025-04-30T06:30:13.054ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
132852025-04-30T06:30:13.058ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132862025-04-30T06:30:13.070ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
132872025-04-30T06:30:13.071ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
132882025-04-30T06:30:13.071ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
132892025-04-30T06:30:13.072ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
132902025-04-30T06:30:13.073ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "93719507-2eb7-4ba8-832a-1e7b6e2e4f1e", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132912025-04-30T06:30:13.073ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
132922025-04-30T06:30:13.074ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
132932025-04-30T06:30:13.074ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
132942025-04-30T06:30:13.075ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
132952025-04-30T06:30:13.075ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c769647f-c9d7-49ea-8319-ca9e1cbfc9b6", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132962025-04-30T06:30:13.076ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
132972025-04-30T06:30:13.096ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "065fcc1f-58f1-44fa-aef8-9fbff18fb0e6", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
132982025-04-30T06:30:13.096ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
132992025-04-30T06:30:13.096ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "125abf42-0fe9-411a-9d25-8f5bcb7a831a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133002025-04-30T06:30:13.096ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
133012025-04-30T06:30:13.096ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd5754f0-feba-4a8f-937e-d9c32c359328", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133022025-04-30T06:30:13.096ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
133032025-04-30T06:30:13.097ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d729aa4-3f11-4426-8112-ff84decfe1c6", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133042025-04-30T06:30:13.097ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
133052025-04-30T06:30:13.097ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f782a6fa-23e1-4293-96ac-b906907815ce", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133062025-04-30T06:30:13.097ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
133072025-04-30T06:30:13.097ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e01105e3-c526-4f94-b962-4043cec1ae1b", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133082025-04-30T06:30:13.097ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
133092025-04-30T06:30:13.103ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "10b6f541-7c59-4a09-b55e-db2ab22b2614", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133102025-04-30T06:30:13.106ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
133112025-04-30T06:30:13.106ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "281213fd-55e2-4460-8c2c-2c29815e934a", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133122025-04-30T06:30:13.106ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
133132025-04-30T06:30:13.109ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "636594e7-bab7-4262-be1e-9defa8559611", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133142025-04-30T06:30:13.109ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
133152025-04-30T06:30:13.111ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7770059d-8eef-496a-bdc8-44874c910b70", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133162025-04-30T06:30:13.112ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
133172025-04-30T06:30:13.114ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b4c4e56-d6d9-4bc7-b7e8-b7b2af5b515e", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133182025-04-30T06:30:13.117ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
133192025-04-30T06:30:13.118ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ebb71e4-44ca-45b8-bd0c-dca01fc8f970", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133202025-04-30T06:30:13.118ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
133212025-04-30T06:30:13.127ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "04be50c1-4e5b-4ee9-a642-3d7a76a71823", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133222025-04-30T06:30:13.129ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
133232025-04-30T06:30:13.129ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "459cde18-05b4-4f46-bb39-fb8b907b2336", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133242025-04-30T06:30:13.130ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
133252025-04-30T06:30:13.138ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
133262025-04-30T06:30:13.139ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "549e279f-19af-44a4-9c8a-d35d1e2f3135", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133272025-04-30T06:30:13.139ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
133282025-04-30T06:30:13.139ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
133292025-04-30T06:30:13.139ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
133302025-04-30T06:30:13.139ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
133312025-04-30T06:30:13.146ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
133322025-04-30T06:30:13.152ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133332025-04-30T06:30:13.160ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
133342025-04-30T06:30:13.160ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
133352025-04-30T06:30:13.160ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
133362025-04-30T06:30:13.160ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
133372025-04-30T06:30:13.160ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
133382025-04-30T06:30:13.161ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
133392025-04-30T06:30:13.167ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133402025-04-30T06:30:13.174ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
133412025-04-30T06:30:13.175ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
133422025-04-30T06:30:13.175ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
133432025-04-30T06:30:13.177ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
133442025-04-30T06:30:13.245ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
133452025-04-30T06:30:13.245ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
133462025-04-30T06:30:13.245ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
133472025-04-30T06:30:13.245ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
133482025-04-30T06:30:13.246ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
133492025-04-30T06:30:13.246ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
133502025-04-30T06:30:13.246ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
133512025-04-30T06:30:13.247ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:56653 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
133522025-04-30T06:30:13.247ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:56653 req_id = 872a3a2d-3f27-45cb-9da8-2db5a53de05a sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
133532025-04-30T06:30:13.248ZINFOtest_image_create (dropshot): request completed latency_us = 722 local_addr = [::1]:42828 method = GET remote_addr = [::1]:56653 req_id = 872a3a2d-3f27-45cb-9da8-2db5a53de05a response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
133542025-04-30T06:30:13.249ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "872a3a2d-3f27-45cb-9da8-2db5a53de05a", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133552025-04-30T06:30:13.252ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
133562025-04-30T06:30:13.252ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
133572025-04-30T06:30:13.252ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
133582025-04-30T06:30:13.255ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
133592025-04-30T06:30:13.255ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
133602025-04-30T06:30:13.255ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
133612025-04-30T06:30:13.255ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
133622025-04-30T06:30:13.257ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
133632025-04-30T06:30:13.257ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133642025-04-30T06:30:13.266ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
133652025-04-30T06:30:13.266ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
133662025-04-30T06:30:13.266ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
133672025-04-30T06:30:13.270ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
133682025-04-30T06:30:13.273ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133692025-04-30T06:30:13.282ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
133702025-04-30T06:30:13.282ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
133712025-04-30T06:30:13.282ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
133722025-04-30T06:30:13.285ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
133732025-04-30T06:30:13.285ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
133742025-04-30T06:30:13.285ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
133752025-04-30T06:30:13.286ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
133762025-04-30T06:30:13.307ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
133772025-04-30T06:30:13.308ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
133782025-04-30T06:30:13.308ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb99ff4-9fcf-4609-95d1-4019778d0934 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
133792025-04-30T06:30:13.309ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb99ff4-9fcf-4609-95d1-4019778d0934 resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
133802025-04-30T06:30:13.309ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb99ff4-9fcf-4609-95d1-4019778d0934 roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
133812025-04-30T06:30:13.317ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb99ff4-9fcf-4609-95d1-4019778d0934 resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
133822025-04-30T06:30:13.321ZINFOtest_image_create (dropshot_internal): request completed latency_us = 12976 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 5bb99ff4-9fcf-4609-95d1-4019778d0934 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
133832025-04-30T06:30:13.323ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb99ff4-9fcf-4609-95d1-4019778d0934", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133842025-04-30T06:30:13.323ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
133852025-04-30T06:30:13.323ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 190cc15a-9b49-4c1e-9a50-382cd8afc44f uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
133862025-04-30T06:30:13.324ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 190cc15a-9b49-4c1e-9a50-382cd8afc44f resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
133872025-04-30T06:30:13.325ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 190cc15a-9b49-4c1e-9a50-382cd8afc44f roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
133882025-04-30T06:30:13.325ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 190cc15a-9b49-4c1e-9a50-382cd8afc44f resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
133892025-04-30T06:30:13.329ZINFOtest_image_create (dropshot_internal): request completed latency_us = 5389 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 190cc15a-9b49-4c1e-9a50-382cd8afc44f response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
133902025-04-30T06:30:13.332ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "190cc15a-9b49-4c1e-9a50-382cd8afc44f", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
133912025-04-30T06:30:13.332ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
133922025-04-30T06:30:13.332ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
133932025-04-30T06:30:13.332ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
133942025-04-30T06:30:13.332ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
133952025-04-30T06:30:13.333ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
133962025-04-30T06:30:13.333ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 508.5386ms iteration = 48 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
133972025-04-30T06:30:13.334ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 49 reason = Signaled
133982025-04-30T06:30:13.334ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
133992025-04-30T06:30:13.334ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
134002025-04-30T06:30:13.334ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
134012025-04-30T06:30:13.334ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
134022025-04-30T06:30:13.336ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
134032025-04-30T06:30:13.337ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
134042025-04-30T06:30:13.338ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134052025-04-30T06:30:13.346ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
134062025-04-30T06:30:13.351ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
134072025-04-30T06:30:13.351ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
134082025-04-30T06:30:13.352ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
134092025-04-30T06:30:13.355ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
134102025-04-30T06:30:13.355ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
134112025-04-30T06:30:13.357ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: f5 91 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:53500 req_id = 253b326e-e28a-4e84-9a43-d78a4a3d1d8c
134122025-04-30T06:30:13.358ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62865,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:53500 req_id = 253b326e-e28a-4e84-9a43-d78a4a3d1d8c
134132025-04-30T06:30:13.359ZDEBGtest_image_create (store): query key key = _mgs._tcp
134142025-04-30T06:30:13.359ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
134152025-04-30T06:30:13.359ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:53500 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 253b326e-e28a-4e84-9a43-d78a4a3d1d8c
134162025-04-30T06:30:13.361ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3478, tv_nsec: 160823619 } })
134172025-04-30T06:30:13.362ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
134182025-04-30T06:30:13.362ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: e9 7a 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .z..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:58957 req_id = 49ec5d35-12a0-4aaf-9dc1-783e257463ee
134192025-04-30T06:30:13.362ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 59770,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:58957 req_id = 49ec5d35-12a0-4aaf-9dc1-783e257463ee
134202025-04-30T06:30:13.363ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
134212025-04-30T06:30:13.363ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:58957 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 49ec5d35-12a0-4aaf-9dc1-783e257463ee
134222025-04-30T06:30:13.436ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
134232025-04-30T06:30:13.437ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
134242025-04-30T06:30:13.437ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
134252025-04-30T06:30:13.437ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
134262025-04-30T06:30:13.437ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
134272025-04-30T06:30:13.438ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
134282025-04-30T06:30:13.439ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
134292025-04-30T06:30:13.439ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
134302025-04-30T06:30:13.441ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 79 5b 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c y[..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:64701 req_id = 31cbd5ee-2a0f-4156-ace9-f7c0d5640af4
134312025-04-30T06:30:13.441ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 31067,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64701 req_id = 31cbd5ee-2a0f-4156-ace9-f7c0d5640af4
134322025-04-30T06:30:13.442ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
134332025-04-30T06:30:13.442ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31067, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:64701 req_id = 31cbd5ee-2a0f-4156-ace9-f7c0d5640af4
134342025-04-30T06:30:13.445ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
134352025-04-30T06:30:13.445ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
134362025-04-30T06:30:13.445ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
134372025-04-30T06:30:13.448ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
134382025-04-30T06:30:13.449ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
134392025-04-30T06:30:13.449ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
134402025-04-30T06:30:13.449ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
134412025-04-30T06:30:13.449ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134422025-04-30T06:30:13.460ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
134432025-04-30T06:30:13.460ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
134442025-04-30T06:30:13.460ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
134452025-04-30T06:30:13.461ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
134462025-04-30T06:30:13.465ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
134472025-04-30T06:30:13.465ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
134482025-04-30T06:30:13.466ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
134492025-04-30T06:30:13.466ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b53b65c-1fe3-4627-8d48-7e6e120e2e52", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134502025-04-30T06:30:13.466ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
134512025-04-30T06:30:13.469ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:39980 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
134522025-04-30T06:30:13.470ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:39980 req_id = dbc6820f-971e-4716-a054-89ad103037bf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
134532025-04-30T06:30:13.470ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 296 local_addr = [::1]:62787 method = GET remote_addr = [::1]:39980 req_id = dbc6820f-971e-4716-a054-89ad103037bf response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
134542025-04-30T06:30:13.471ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b18926b4-1b2e-444a-ae49-9e8014419a60", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134552025-04-30T06:30:13.471ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
134562025-04-30T06:30:13.475ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "316bcf75-a11b-4810-8ae1-9a8e52179fde", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134572025-04-30T06:30:13.475ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
134582025-04-30T06:30:13.477ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2af13f-66b2-42fe-a298-6b891243305b", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134592025-04-30T06:30:13.477ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
134602025-04-30T06:30:13.480ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "23d1aef8-e33b-4bdf-90e1-c045a82033dd", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134612025-04-30T06:30:13.480ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
134622025-04-30T06:30:13.491ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "00729f4e-1e08-4907-991c-256aba059890", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134632025-04-30T06:30:13.491ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
134642025-04-30T06:30:13.513ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
134652025-04-30T06:30:13.517ZDEBGtest_image_create (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
134662025-04-30T06:30:13.517ZDEBGtest_image_create (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
134672025-04-30T06:30:13.524ZDEBGtest_image_create (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
134682025-04-30T06:30:13.524ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
134692025-04-30T06:30:13.534ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
134702025-04-30T06:30:13.534ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
134712025-04-30T06:30:13.537ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fffe6a1-b29b-4934-a990-af60e652009f", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134722025-04-30T06:30:13.537ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
134732025-04-30T06:30:13.539ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 1 table_name = measurements_i64
134742025-04-30T06:30:13.539ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
134752025-04-30T06:30:13.540ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3faff5d-e166-426b-80f2-62576aca6454", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134762025-04-30T06:30:13.542ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
134772025-04-30T06:30:13.542ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c599b9d8-f6de-4dba-ab9f-a1f5014c7b7d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134782025-04-30T06:30:13.542ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
134792025-04-30T06:30:13.542ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "827991ed-9dd9-46d3-8dfd-26d00fae2961", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134802025-04-30T06:30:13.543ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
134812025-04-30T06:30:13.544ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ed54309-139f-412a-974a-fc7148f8d7ae", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134822025-04-30T06:30:13.544ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
134832025-04-30T06:30:13.545ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e7cbf0f-dd51-4681-a7d6-0b5205e109aa", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134842025-04-30T06:30:13.545ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
134852025-04-30T06:30:13.546ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b193c11f-7d5a-4017-af0f-3980aa675d39", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134862025-04-30T06:30:13.547ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
134872025-04-30T06:30:13.550ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca273fa6-4339-4abc-a9c0-00f47ae5d919", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134882025-04-30T06:30:13.551ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
134892025-04-30T06:30:13.552ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa18753-f095-44d3-9652-bc493754c044", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134902025-04-30T06:30:13.553ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
134912025-04-30T06:30:13.554ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "751c4b0b-e9ae-41ce-bfc8-7cf9ba425306", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134922025-04-30T06:30:13.556ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
134932025-04-30T06:30:13.563ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ef1131a-c09b-459d-a20c-cdbb521d7ea3", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
134942025-04-30T06:30:13.563ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
134952025-04-30T06:30:13.565ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
134962025-04-30T06:30:13.566ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
134972025-04-30T06:30:13.567ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
134982025-04-30T06:30:13.567ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
134992025-04-30T06:30:13.568ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
135002025-04-30T06:30:13.576ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdfbc329-e369-48ea-97bb-ee747b516c98", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135012025-04-30T06:30:13.576ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
135022025-04-30T06:30:13.577ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135032025-04-30T06:30:13.596ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
135042025-04-30T06:30:13.597ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
135052025-04-30T06:30:13.597ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
135062025-04-30T06:30:13.597ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
135072025-04-30T06:30:13.601ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
135082025-04-30T06:30:13.601ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
135092025-04-30T06:30:13.603ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
135102025-04-30T06:30:13.622ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d40cbae8-5b9a-4b23-9636-ae6c99f14b7d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135112025-04-30T06:30:13.625ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
135122025-04-30T06:30:13.625ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
135132025-04-30T06:30:13.626ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "759e9178-a0d3-478b-b367-6908bb4214dc", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135142025-04-30T06:30:13.626ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
135152025-04-30T06:30:13.628ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce937298-13f4-4710-8252-c282946eb407", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135162025-04-30T06:30:13.628ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
135172025-04-30T06:30:13.631ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "397b521c-9100-478d-b05e-9345e9b228f7", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135182025-04-30T06:30:13.632ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
135192025-04-30T06:30:13.636ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "44203eff-eda2-4174-9d91-bcddfaf8c90c", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135202025-04-30T06:30:13.636ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
135212025-04-30T06:30:13.638ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a29ca015-65d6-472f-9e9b-e79aeb526a58", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135222025-04-30T06:30:13.638ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
135232025-04-30T06:30:13.643ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6610a631-80a9-4b04-84e8-0367ebc6a8e1", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135242025-04-30T06:30:13.644ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
135252025-04-30T06:30:13.646ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8072fc9-aca3-44ee-9637-f82284b1497d", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135262025-04-30T06:30:13.647ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
135272025-04-30T06:30:13.661ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb750f1-ca5f-47cb-b52f-0259626b248f", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135282025-04-30T06:30:13.662ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
135292025-04-30T06:30:13.670ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "68e7fd68-ffe3-4b07-8959-6094cde49f12", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135302025-04-30T06:30:13.670ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
135312025-04-30T06:30:13.671ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
135322025-04-30T06:30:13.676ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7528420-1122-48a3-864f-cfdd3ba97cc7", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135332025-04-30T06:30:13.676ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
135342025-04-30T06:30:13.678ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6a38cac-a8f7-4103-b5fc-59a3a2d85771", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135352025-04-30T06:30:13.678ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
135362025-04-30T06:30:13.679ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6576c5ba-4caf-4877-a702-771e28ddd5d7", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135372025-04-30T06:30:13.680ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
135382025-04-30T06:30:13.681ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c243ec56-53ca-46a5-8d85-662db876d3de", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135392025-04-30T06:30:13.681ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
135402025-04-30T06:30:13.684ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "01c13a4d-742d-4fff-a2c2-01d8863a1d74", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135412025-04-30T06:30:13.684ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
135422025-04-30T06:30:13.685ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "28651676-39fc-4414-8529-c6f4fec4814e", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135432025-04-30T06:30:13.685ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
135442025-04-30T06:30:13.687ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca64cda3-19ca-4ac7-9542-e3c902bde565", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135452025-04-30T06:30:13.687ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
135462025-04-30T06:30:13.689ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a15ad0d1-390e-46b4-bab9-e8b714fadfab", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135472025-04-30T06:30:13.690ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
135482025-04-30T06:30:13.692ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd82ef7c-dea9-46ab-ae4f-ae0a91e968d3", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135492025-04-30T06:30:13.692ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
135502025-04-30T06:30:13.697ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "336bd3c4-916d-4781-b326-22d329c0404e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135512025-04-30T06:30:13.698ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
135522025-04-30T06:30:13.700ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "139b3c49-578b-4d2d-a34b-18bfd018d87d", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135532025-04-30T06:30:13.700ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
135542025-04-30T06:30:13.704ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "91678f46-7159-4b6f-a8c6-e36ce288d033", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135552025-04-30T06:30:13.704ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
135562025-04-30T06:30:13.717ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d09fe15-afee-4ab8-b1b5-086060a2e32d", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135572025-04-30T06:30:13.717ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
135582025-04-30T06:30:13.719ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e4a67f-04fa-4483-b67e-9e744dcb77cf", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135592025-04-30T06:30:13.719ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
135602025-04-30T06:30:13.721ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c29886d-0514-4f18-9b05-fb73c7f308e5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135612025-04-30T06:30:13.735ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
135622025-04-30T06:30:13.736ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
135632025-04-30T06:30:13.736ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
135642025-04-30T06:30:13.736ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
135652025-04-30T06:30:13.737ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
135662025-04-30T06:30:13.738ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
135672025-04-30T06:30:13.740ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a7b84f9-d4a4-41b5-9292-76a60058ee5e", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135682025-04-30T06:30:13.740ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
135692025-04-30T06:30:13.741ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135702025-04-30T06:30:13.755ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
135712025-04-30T06:30:13.755ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
135722025-04-30T06:30:13.757ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
135732025-04-30T06:30:13.758ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
135742025-04-30T06:30:13.760ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "45805ed1-9fa0-41f4-9720-06dd30515927", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:12 GMT"} })
135752025-04-30T06:30:13.760ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
135762025-04-30T06:30:13.761ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
135772025-04-30T06:30:13.761ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
135782025-04-30T06:30:13.761ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
135792025-04-30T06:30:13.762ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
135802025-04-30T06:30:13.763ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
135812025-04-30T06:30:13.763ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
135822025-04-30T06:30:13.765ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
135832025-04-30T06:30:13.770ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135842025-04-30T06:30:13.778ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
135852025-04-30T06:30:13.778ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
135862025-04-30T06:30:13.778ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
135872025-04-30T06:30:13.778ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
135882025-04-30T06:30:13.778ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
135892025-04-30T06:30:13.780ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
135902025-04-30T06:30:13.787ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135912025-04-30T06:30:13.798ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
135922025-04-30T06:30:13.798ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
135932025-04-30T06:30:13.799ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
135942025-04-30T06:30:13.802ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
135952025-04-30T06:30:13.882ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
135962025-04-30T06:30:13.882ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
135972025-04-30T06:30:13.883ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:51523 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
135982025-04-30T06:30:13.884ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:51523 req_id = 93e2e327-117b-41cd-b84e-506e1b43b50c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
135992025-04-30T06:30:13.884ZINFOtest_image_create (dropshot): request completed latency_us = 866 local_addr = [::1]:42828 method = GET remote_addr = [::1]:51523 req_id = 93e2e327-117b-41cd-b84e-506e1b43b50c response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
136002025-04-30T06:30:13.885ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "93e2e327-117b-41cd-b84e-506e1b43b50c", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:13 GMT"} })
136012025-04-30T06:30:13.889ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
136022025-04-30T06:30:13.889ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
136032025-04-30T06:30:13.889ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
136042025-04-30T06:30:13.892ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
136052025-04-30T06:30:13.892ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
136062025-04-30T06:30:13.893ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
136072025-04-30T06:30:13.893ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136082025-04-30T06:30:13.894ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
136092025-04-30T06:30:13.900ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136102025-04-30T06:30:13.908ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
136112025-04-30T06:30:13.909ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
136122025-04-30T06:30:13.909ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136132025-04-30T06:30:13.912ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
136142025-04-30T06:30:13.913ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
136152025-04-30T06:30:13.914ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 28 d1 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 (............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:60514 req_id = 9fcfaae4-1ad4-4153-982f-9af61347348a
136162025-04-30T06:30:13.914ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 10449,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:60514 req_id = 9fcfaae4-1ad4-4153-982f-9af61347348a
136172025-04-30T06:30:13.914ZDEBGtest_image_create (store): query key key = _dendrite._tcp
136182025-04-30T06:30:13.915ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
136192025-04-30T06:30:13.915ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:60514 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 9fcfaae4-1ad4-4153-982f-9af61347348a
136202025-04-30T06:30:13.921ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3478, tv_nsec: 720048708 } })
136212025-04-30T06:30:13.921ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
136222025-04-30T06:30:13.922ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 25 45 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e %E..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:61408 req_id = bb380908-f8f6-4feb-af7c-3386cf947daa
136232025-04-30T06:30:13.923ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 9541,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61408 req_id = bb380908-f8f6-4feb-af7c-3386cf947daa
136242025-04-30T06:30:13.923ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
136252025-04-30T06:30:13.923ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:61408 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = bb380908-f8f6-4feb-af7c-3386cf947daa
136262025-04-30T06:30:13.924ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector
136272025-04-30T06:30:13.991ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector zone_address = ::1
136282025-04-30T06:30:13.991ZDEBGtest_image_create (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[::1]:12225/local/switch-id
136292025-04-30T06:30:13.991ZDEBGtest_image_create (MgsClient): client response background_task = nat_v4_garbage_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
136302025-04-30T06:30:13.991ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = nat_v4_garbage_collector reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
136312025-04-30T06:30:13.993ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = nat_v4_garbage_collector
136322025-04-30T06:30:14.015ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
136332025-04-30T06:30:14.033ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
136342025-04-30T06:30:14.034ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
136352025-04-30T06:30:14.035ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
136362025-04-30T06:30:14.035ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 701.185937ms iteration = 49 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
136372025-04-30T06:30:14.035ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 50 reason = Signaled
136382025-04-30T06:30:14.035ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
136392025-04-30T06:30:14.035ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
136402025-04-30T06:30:14.035ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
136412025-04-30T06:30:14.035ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136422025-04-30T06:30:14.036ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
136432025-04-30T06:30:14.036ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: dd d0 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:54334 req_id = bc865460-d2ca-4e5f-850d-5c79c3e9648b
136442025-04-30T06:30:14.036ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56784,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54334 req_id = bc865460-d2ca-4e5f-850d-5c79c3e9648b
136452025-04-30T06:30:14.036ZDEBGtest_image_create (store): query key key = _dendrite._tcp
136462025-04-30T06:30:14.037ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
136472025-04-30T06:30:14.037ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:54334 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = bc865460-d2ca-4e5f-850d-5c79c3e9648b
136482025-04-30T06:30:14.037ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3478, tv_nsec: 836418016 } })
136492025-04-30T06:30:14.037ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
136502025-04-30T06:30:14.038ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 4c 00 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e L...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:57022 req_id = 7d2d5a8c-ae79-4774-b02e-86b37fc803e9
136512025-04-30T06:30:14.038ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 19456,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:57022 req_id = 7d2d5a8c-ae79-4774-b02e-86b37fc803e9
136522025-04-30T06:30:14.038ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
136532025-04-30T06:30:14.038ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:57022 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 7d2d5a8c-ae79-4774-b02e-86b37fc803e9
136542025-04-30T06:30:14.039ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager
136552025-04-30T06:30:14.090ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager zone_address = ::1
136562025-04-30T06:30:14.090ZDEBGtest_image_create (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[::1]:12225/local/switch-id
136572025-04-30T06:30:14.090ZDEBGtest_image_create (MgsClient): client response background_task = bfd_manager result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
136582025-04-30T06:30:14.090ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = bfd_manager reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
136592025-04-30T06:30:14.091ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = bfd_manager
136602025-04-30T06:30:14.091ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136612025-04-30T06:30:14.097ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
136622025-04-30T06:30:14.097ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
136632025-04-30T06:30:14.097ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136642025-04-30T06:30:14.097ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
136652025-04-30T06:30:14.098ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
136662025-04-30T06:30:14.099ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
136672025-04-30T06:30:14.099ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
136682025-04-30T06:30:14.099ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
136692025-04-30T06:30:14.100ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
136702025-04-30T06:30:14.102ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
136712025-04-30T06:30:14.103ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
136722025-04-30T06:30:14.103ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 56 72 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 Vr..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:49406 req_id = 72dd53d3-a829-419d-9438-3468ec489dc0
136732025-04-30T06:30:14.103ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 22130,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:49406 req_id = 72dd53d3-a829-419d-9438-3468ec489dc0
136742025-04-30T06:30:14.103ZDEBGtest_image_create (store): query key key = _mgs._tcp
136752025-04-30T06:30:14.103ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
136762025-04-30T06:30:14.104ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:49406 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 72dd53d3-a829-419d-9438-3468ec489dc0
136772025-04-30T06:30:14.107ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3478, tv_nsec: 905830126 } })
136782025-04-30T06:30:14.107ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
136792025-04-30T06:30:14.107ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136802025-04-30T06:30:14.123ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
136812025-04-30T06:30:14.128ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
136822025-04-30T06:30:14.128ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
136832025-04-30T06:30:14.129ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
136842025-04-30T06:30:14.131ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 61 ea 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e a...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51431 req_id = 438b204b-6246-4bab-8248-96f584ded096
136852025-04-30T06:30:14.131ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25066,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51431 req_id = 438b204b-6246-4bab-8248-96f584ded096
136862025-04-30T06:30:14.140ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
136872025-04-30T06:30:14.140ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51431 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = 438b204b-6246-4bab-8248-96f584ded096
136882025-04-30T06:30:14.255ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
136892025-04-30T06:30:14.257ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
136902025-04-30T06:30:14.257ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
136912025-04-30T06:30:14.257ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
136922025-04-30T06:30:14.259ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: aa e9 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:55046 req_id = 90d1a18c-7e68-4231-83d3-b37512578cb5
136932025-04-30T06:30:14.259ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 43753,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:55046 req_id = 90d1a18c-7e68-4231-83d3-b37512578cb5
136942025-04-30T06:30:14.259ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
136952025-04-30T06:30:14.259ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43753, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:55046 req_id = 90d1a18c-7e68-4231-83d3-b37512578cb5
136962025-04-30T06:30:14.917ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
136972025-04-30T06:30:14.917ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
136982025-04-30T06:30:14.918ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
136992025-04-30T06:30:14.918ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:46732 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
137002025-04-30T06:30:14.918ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:55425 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
137012025-04-30T06:30:14.919ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:36735 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
137022025-04-30T06:30:14.919ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:44678 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
137032025-04-30T06:30:14.919ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:33077 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
137042025-04-30T06:30:14.919ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:57160 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
137052025-04-30T06:30:14.919ZINFOtest_image_create (dropshot): accepted connection kind = pantry local_addr = [::1]:62787 remote_addr = [::1]:64126 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
137062025-04-30T06:30:14.920ZTRACtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
137072025-04-30T06:30:14.920ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
137082025-04-30T06:30:14.921ZTRACtest_image_create (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
137092025-04-30T06:30:14.921ZTRACtest_image_create (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
137102025-04-30T06:30:14.922ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
137112025-04-30T06:30:14.926ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:46732 req_id = 20d6a85a-7be1-454a-9ea0-27ff1ce5d226 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137122025-04-30T06:30:14.928ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:55425 req_id = a4227d6e-0735-402f-b425-392b7634a4df sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137132025-04-30T06:30:14.928ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:36735 req_id = 0b8ab9ce-3acc-47c1-8d1d-7c3a986f3c14 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137142025-04-30T06:30:14.929ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:44678 req_id = 3431057c-d328-4d09-a945-bd1bfa266372 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137152025-04-30T06:30:14.929ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:33077 req_id = 7a02d44b-9fca-48da-b6ea-d1fc73e3f108 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137162025-04-30T06:30:14.929ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:57160 req_id = af74f425-3eec-49d1-b1d6-14c2863c905e sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137172025-04-30T06:30:14.930ZTRACtest_image_create (dropshot): incoming request kind = pantry local_addr = [::1]:62787 method = GET remote_addr = [::1]:64126 req_id = c7e623f5-6875-4a0f-a6f5-4f20adbd5ae1 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137182025-04-30T06:30:14.931ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 5732 local_addr = [::1]:62787 method = GET remote_addr = [::1]:46732 req_id = 20d6a85a-7be1-454a-9ea0-27ff1ce5d226 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137192025-04-30T06:30:14.932ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 3825 local_addr = [::1]:62787 method = GET remote_addr = [::1]:55425 req_id = a4227d6e-0735-402f-b425-392b7634a4df response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137202025-04-30T06:30:14.932ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 3730 local_addr = [::1]:62787 method = GET remote_addr = [::1]:36735 req_id = 0b8ab9ce-3acc-47c1-8d1d-7c3a986f3c14 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137212025-04-30T06:30:14.932ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 3794 local_addr = [::1]:62787 method = GET remote_addr = [::1]:44678 req_id = 3431057c-d328-4d09-a945-bd1bfa266372 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137222025-04-30T06:30:14.933ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 3711 local_addr = [::1]:62787 method = GET remote_addr = [::1]:33077 req_id = 7a02d44b-9fca-48da-b6ea-d1fc73e3f108 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137232025-04-30T06:30:14.933ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 3613 local_addr = [::1]:62787 method = GET remote_addr = [::1]:57160 req_id = af74f425-3eec-49d1-b1d6-14c2863c905e response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137242025-04-30T06:30:14.933ZINFOtest_image_create (dropshot): request completed kind = pantry latency_us = 3396 local_addr = [::1]:62787 method = GET remote_addr = [::1]:64126 req_id = c7e623f5-6875-4a0f-a6f5-4f20adbd5ae1 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
137252025-04-30T06:30:14.936ZTRACtest_image_create (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 77 78 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 wx..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:61919 req_id = 70e9db72-676d-44b3-ae58-394ade0107e9
137262025-04-30T06:30:14.937ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 30584,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:61919 req_id = 70e9db72-676d-44b3-ae58-394ade0107e9
137272025-04-30T06:30:14.937ZDEBGtest_image_create (store): query key key = _dendrite._tcp
137282025-04-30T06:30:14.938ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
137292025-04-30T06:30:14.938ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:61919 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 70e9db72-676d-44b3-ae58-394ade0107e9
137302025-04-30T06:30:14.939ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
137312025-04-30T06:30:14.941ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
137322025-04-30T06:30:14.941ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
137332025-04-30T06:30:14.941ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
137342025-04-30T06:30:14.943ZDEBGtest_image_create (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 39702, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3479, tv_nsec: 742742589 } })
137352025-04-30T06:30:14.943ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
137362025-04-30T06:30:14.951ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 62 ac 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e b...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:64939 req_id = e4d18386-ca9a-4729-85d9-f14738cc20af
137372025-04-30T06:30:14.951ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25260,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:64939 req_id = e4d18386-ca9a-4729-85d9-f14738cc20af
137382025-04-30T06:30:14.952ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
137392025-04-30T06:30:14.952ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:64939 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = e4d18386-ca9a-4729-85d9-f14738cc20af
137402025-04-30T06:30:14.953ZINFOtest_image_create (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
137412025-04-30T06:30:15.038ZINFOtest_image_create (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc zone_address = ::1
137422025-04-30T06:30:15.038ZDEBGtest_image_create (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc uri = http://[::1]:12225/local/switch-id
137432025-04-30T06:30:15.038ZDEBGtest_image_create (MgsClient): client response background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
137442025-04-30T06:30:15.038ZWARNtest_image_create (BackgroundTasks): failed to identify switch slot for dendrite background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc reason = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) zone_address = ::1
137452025-04-30T06:30:15.041ZWARNtest_image_create (BackgroundTasks): Failed to map switch zone addr: Communication Error: error sending request for url (http://[::1]:12225/local/switch-id), retrying background_task = switch_port_config_manager rack_id = c19a698f-c6f9-4a17-ae30-20d711b8f7dc
137462025-04-30T06:30:15.047ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd9daa81-f435-476a-ac29-7be6a0e75d3b", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137472025-04-30T06:30:15.047ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
137482025-04-30T06:30:15.060ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c97bd0b3-a55b-410a-8f7a-a5c819d850ef", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137492025-04-30T06:30:15.060ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
137502025-04-30T06:30:15.076ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5e2b1f5-ba03-4ad7-bfaf-150e1ed06193", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137512025-04-30T06:30:15.076ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
137522025-04-30T06:30:15.079ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f75ad6a-6c6d-4fd5-9a9f-8ce7e23f20ff", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137532025-04-30T06:30:15.079ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
137542025-04-30T06:30:15.081ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
137552025-04-30T06:30:15.084ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f660b8-d844-488c-ac70-c7dec6a93ab6", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137562025-04-30T06:30:15.084ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
137572025-04-30T06:30:15.086ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b2edba9-ebce-43ef-8c1d-b5da017189aa", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137582025-04-30T06:30:15.086ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
137592025-04-30T06:30:15.089ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "109143ed-1516-44ad-b8fc-e6525874da96", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137602025-04-30T06:30:15.089ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
137612025-04-30T06:30:15.091ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "51244e31-ef55-43a1-857d-cc0f9023727d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137622025-04-30T06:30:15.091ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
137632025-04-30T06:30:15.093ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d059d98-bcf2-437f-9b01-fe72c195a69b", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137642025-04-30T06:30:15.094ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
137652025-04-30T06:30:15.097ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1250ba4a-4750-4cf1-ba41-b0b6a887951f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137662025-04-30T06:30:15.098ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
137672025-04-30T06:30:15.099ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "023884a6-f1d7-4ba9-83de-c00a5bc2fab3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137682025-04-30T06:30:15.099ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
137692025-04-30T06:30:15.100ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f22fe629-d9cb-4b0e-ab8e-c288602082aa", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137702025-04-30T06:30:15.100ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
137712025-04-30T06:30:15.101ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7450933d-52b3-4665-b819-767251c73aea", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137722025-04-30T06:30:15.101ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
137732025-04-30T06:30:15.103ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ed15619-0087-4875-8534-57a1f5bc1268", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137742025-04-30T06:30:15.103ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
137752025-04-30T06:30:15.105ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97f12f79-ef03-45d0-9f3f-50970127b4b8", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137762025-04-30T06:30:15.105ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
137772025-04-30T06:30:15.108ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5da7f78e-7509-421b-8274-d9f02d4893ee", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137782025-04-30T06:30:15.108ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
137792025-04-30T06:30:15.111ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "42d6bffa-f90b-42f4-b59c-98cb78a21096", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137802025-04-30T06:30:15.111ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
137812025-04-30T06:30:15.123ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "325da159-b069-4452-97ec-c937dce1326c", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137822025-04-30T06:30:15.123ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
137832025-04-30T06:30:15.128ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f28da10c-608c-4fe3-9ebe-f6f277c9c5f5", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137842025-04-30T06:30:15.129ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
137852025-04-30T06:30:15.132ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
137862025-04-30T06:30:15.132ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
137872025-04-30T06:30:15.132ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
137882025-04-30T06:30:15.132ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
137892025-04-30T06:30:15.133ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
137902025-04-30T06:30:15.134ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ad5b18a-b4af-4daf-b90a-fc19a8dcb502", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137912025-04-30T06:30:15.136ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
137922025-04-30T06:30:15.138ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fb07adb-8686-4dac-92c9-6999db96210f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
137932025-04-30T06:30:15.138ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
137942025-04-30T06:30:15.140ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137952025-04-30T06:30:15.154ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
137962025-04-30T06:30:15.164ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
137972025-04-30T06:30:15.164ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
137982025-04-30T06:30:15.167ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
137992025-04-30T06:30:15.168ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d4ff1e-df96-4163-adaf-7d829f0879e3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138002025-04-30T06:30:15.168ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
138012025-04-30T06:30:15.171ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
138022025-04-30T06:30:15.171ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
138032025-04-30T06:30:15.173ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
138042025-04-30T06:30:15.175ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c470ce61-7255-4019-a48b-a89b1ea948a9", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138052025-04-30T06:30:15.175ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
138062025-04-30T06:30:15.178ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a02078-97c2-4a1d-86c4-359dfd7e9cb6", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138072025-04-30T06:30:15.181ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
138082025-04-30T06:30:15.191ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "636e9ee1-16f8-4d3c-8077-c448d717c258", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138092025-04-30T06:30:15.191ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
138102025-04-30T06:30:15.200ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3af0c11-af10-4e57-bd88-937faccabeb7", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138112025-04-30T06:30:15.200ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
138122025-04-30T06:30:15.205ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e162207-f4c0-420d-9f86-3f745698fc45", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138132025-04-30T06:30:15.205ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
138142025-04-30T06:30:15.210ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd10e940-4d9d-4860-b957-793bb47f5794", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138152025-04-30T06:30:15.210ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
138162025-04-30T06:30:15.211ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
138172025-04-30T06:30:15.221ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "587ea688-4d7d-4496-828a-d9c3b272b127", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138182025-04-30T06:30:15.221ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
138192025-04-30T06:30:15.225ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dd38e0b-f779-4b84-8eea-be77cc6f4c09", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138202025-04-30T06:30:15.225ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
138212025-04-30T06:30:15.226ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e09f0310-f3ab-4667-8211-366b2a5b9c58", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138222025-04-30T06:30:15.226ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
138232025-04-30T06:30:15.227ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b1104a0-61ff-4a07-abbd-96ae55663952", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138242025-04-30T06:30:15.228ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
138252025-04-30T06:30:15.229ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4706d1d4-84f2-4d28-bc0f-0f23ce5a16c0", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138262025-04-30T06:30:15.229ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
138272025-04-30T06:30:15.231ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca22a3f2-847e-4309-8a83-daecd4604b8d", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138282025-04-30T06:30:15.231ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
138292025-04-30T06:30:15.232ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d90c341a-e98b-44c4-b261-2a662f641627", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138302025-04-30T06:30:15.233ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
138312025-04-30T06:30:15.234ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "db1b6bbc-3348-4470-8f91-2da5d028a107", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138322025-04-30T06:30:15.234ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
138332025-04-30T06:30:15.236ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "84fd0192-5060-48a1-89ec-11cc57a4c050", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138342025-04-30T06:30:15.236ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
138352025-04-30T06:30:15.238ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "56f18fd6-b51f-43e1-972c-d8c3b466d966", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138362025-04-30T06:30:15.238ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
138372025-04-30T06:30:15.241ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d27aea63-0ee0-4975-b432-bfa0128c85b0", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138382025-04-30T06:30:15.242ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
138392025-04-30T06:30:15.244ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7201b969-ad15-4b62-bfa9-1509b19e2b1c", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138402025-04-30T06:30:15.246ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
138412025-04-30T06:30:15.249ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "19d8867a-b6fb-4322-b895-2ade797bf35b", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138422025-04-30T06:30:15.249ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
138432025-04-30T06:30:15.251ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d50fc224-e1c9-49c4-abe3-0785a9f0e0fc", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138442025-04-30T06:30:15.251ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
138452025-04-30T06:30:15.253ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bd56059-9042-4361-8576-878bed69cf5f", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138462025-04-30T06:30:15.253ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
138472025-04-30T06:30:15.255ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e997e2c-acfc-49c5-b288-f695634b1901", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138482025-04-30T06:30:15.255ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
138492025-04-30T06:30:15.257ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "18dff2b5-61e3-46db-96de-35299ce34f02", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138502025-04-30T06:30:15.257ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
138512025-04-30T06:30:15.257ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
138522025-04-30T06:30:15.257ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
138532025-04-30T06:30:15.257ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
138542025-04-30T06:30:15.258ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
138552025-04-30T06:30:15.260ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138562025-04-30T06:30:15.264ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
138572025-04-30T06:30:15.264ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
138582025-04-30T06:30:15.264ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
138592025-04-30T06:30:15.264ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
138602025-04-30T06:30:15.264ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
138612025-04-30T06:30:15.264ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
138622025-04-30T06:30:15.265ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
138632025-04-30T06:30:15.265ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
138642025-04-30T06:30:15.265ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
138652025-04-30T06:30:15.265ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
138662025-04-30T06:30:15.266ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
138672025-04-30T06:30:15.267ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138682025-04-30T06:30:15.274ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
138692025-04-30T06:30:15.274ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
138702025-04-30T06:30:15.274ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
138712025-04-30T06:30:15.275ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
138722025-04-30T06:30:15.277ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138732025-04-30T06:30:15.283ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
138742025-04-30T06:30:15.283ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
138752025-04-30T06:30:15.283ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
138762025-04-30T06:30:15.283ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
138772025-04-30T06:30:15.287ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
138782025-04-30T06:30:15.287ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
138792025-04-30T06:30:15.288ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
138802025-04-30T06:30:15.343ZDEBGtest_image_create (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:42828
138812025-04-30T06:30:15.343ZDEBGtest_image_create (BackgroundTasks): client request SledAgent = http://[::1]:42828 background_task = inventory_collection body = None method = GET uri = http://[::1]:42828/inventory
138822025-04-30T06:30:15.345ZINFOtest_image_create (dropshot): accepted connection local_addr = [::1]:42828 remote_addr = [::1]:56682 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
138832025-04-30T06:30:15.345ZINFOtest_image_create (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:562
138842025-04-30T06:30:15.346ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
138852025-04-30T06:30:15.346ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a04cd031-17e0-4280-bc95-0f69be75f1eb uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
138862025-04-30T06:30:15.346ZTRACtest_image_create (dropshot): incoming request local_addr = [::1]:42828 method = GET remote_addr = [::1]:56682 req_id = 2042a3b1-e8c0-473f-9ace-60f74abd26c7 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
138872025-04-30T06:30:15.346ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a04cd031-17e0-4280-bc95-0f69be75f1eb resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
138882025-04-30T06:30:15.346ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a04cd031-17e0-4280-bc95-0f69be75f1eb roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
138892025-04-30T06:30:15.347ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a04cd031-17e0-4280-bc95-0f69be75f1eb resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
138902025-04-30T06:30:15.348ZINFOtest_image_create (dropshot): request completed latency_us = 1841 local_addr = [::1]:42828 method = GET remote_addr = [::1]:56682 req_id = 2042a3b1-e8c0-473f-9ace-60f74abd26c7 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
138912025-04-30T06:30:15.349ZDEBGtest_image_create (BackgroundTasks): client response SledAgent = http://[::1]:42828 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:42828/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2042a3b1-e8c0-473f-9ace-60f74abd26c7", "content-length": "3141", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
138922025-04-30T06:30:15.351ZDEBGtest_image_create (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
138932025-04-30T06:30:15.351ZDEBGtest_image_create (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
138942025-04-30T06:30:15.352ZDEBGtest_image_create (BackgroundTasks): finished collection background_task = inventory_collection
138952025-04-30T06:30:15.354ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
138962025-04-30T06:30:15.354ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
138972025-04-30T06:30:15.354ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
138982025-04-30T06:30:15.354ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
138992025-04-30T06:30:15.355ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
139002025-04-30T06:30:15.358ZINFOtest_image_create (dropshot_internal): request completed latency_us = 12603 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = a04cd031-17e0-4280-bc95-0f69be75f1eb response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
139012025-04-30T06:30:15.359ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a04cd031-17e0-4280-bc95-0f69be75f1eb", "content-length": "405", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139022025-04-30T06:30:15.359ZDEBGtest_image_create (oximeter): client request body = None method = GET uri = http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
139032025-04-30T06:30:15.360ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139042025-04-30T06:30:15.368ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
139052025-04-30T06:30:15.368ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
139062025-04-30T06:30:15.369ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
139072025-04-30T06:30:15.370ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
139082025-04-30T06:30:15.371ZTRACtest_image_create (dropshot_internal): incoming request local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 9ea5bbe5-c4d6-4a07-ae5d-d4da3a10a11f uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
139092025-04-30T06:30:15.372ZTRACtest_image_create (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 9ea5bbe5-c4d6-4a07-ae5d-d4da3a10a11f resource = Database uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
139102025-04-30T06:30:15.372ZDEBGtest_image_create (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 9ea5bbe5-c4d6-4a07-ae5d-d4da3a10a11f roles = RoleSet { roles: {} } uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
139112025-04-30T06:30:15.372ZDEBGtest_image_create (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 9ea5bbe5-c4d6-4a07-ae5d-d4da3a10a11f resource = Database result = Ok(()) uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
139122025-04-30T06:30:15.379ZINFOtest_image_create (dropshot_internal): request completed latency_us = 7063 local_addr = 127.0.0.1:35774 method = GET remote_addr = 127.0.0.1:46899 req_id = 9ea5bbe5-c4d6-4a07-ae5d-d4da3a10a11f response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
139132025-04-30T06:30:15.384ZDEBGtest_image_create (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:35774/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ea5bbe5-c4d6-4a07-ae5d-d4da3a10a11f", "content-length": "29", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139142025-04-30T06:30:15.385ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 95c1b5e8-ea6c-4c8c-ba71-c9f1b8d4fd32
139152025-04-30T06:30:15.385ZTRACtest_image_create (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
139162025-04-30T06:30:15.385ZINFOtest_image_create (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:637 n_current_tasks = 2 n_pruned_tasks = 0
139172025-04-30T06:30:15.408ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
139182025-04-30T06:30:15.423ZDEBGtest_image_create (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
139192025-04-30T06:30:15.424ZDEBGtest_image_create (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
139202025-04-30T06:30:15.424ZWARNtest_image_create (datastore): Non-retryable transaction failure err = DatabaseError(UniqueViolation, "duplicate key value violates unique constraint \\"inv_caboose_pkey\\"") transaction = inventory_insert_collection
139212025-04-30T06:30:15.425ZWARNtest_image_create (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint "inv_caboose_pkey"
139222025-04-30T06:30:15.425ZDEBGtest_image_create (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.389831669s iteration = 50 status = {"error":"failed to collect inventory: saving inventory to database: Internal Error: unexpected database error: duplicate key value violates unique constraint \\"inv_caboose_pkey\\""}
139232025-04-30T06:30:15.425ZDEBGtest_image_create (BackgroundTasks): activating background_task = inventory_collection iteration = 51 reason = Signaled
139242025-04-30T06:30:15.425ZTRACtest_image_create (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory
139252025-04-30T06:30:15.425ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
139262025-04-30T06:30:15.425ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
139272025-04-30T06:30:15.425ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
139282025-04-30T06:30:15.426ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
139292025-04-30T06:30:15.430ZTRACtest_image_create (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
139302025-04-30T06:30:15.430ZDEBGtest_image_create (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
139312025-04-30T06:30:15.431ZTRACtest_image_create (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
139322025-04-30T06:30:15.431ZTRACtest_image_create (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
139332025-04-30T06:30:15.431ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139342025-04-30T06:30:15.437ZDEBGtest_image_create (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
139352025-04-30T06:30:15.437ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
139362025-04-30T06:30:15.437ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
139372025-04-30T06:30:15.438ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
139382025-04-30T06:30:15.443ZDEBGtest_image_create (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(11ad27d1-d8a5-479d-a93a-f42ca9630a57, 0)]
139392025-04-30T06:30:15.445ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
139402025-04-30T06:30:15.447ZTRACtest_image_create (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: fc 5d 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .]..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:59295 req_id = 352f2422-e3cd-4c14-a866-c31454c425ed
139412025-04-30T06:30:15.447ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64605,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:59295 req_id = 352f2422-e3cd-4c14-a866-c31454c425ed
139422025-04-30T06:30:15.447ZDEBGtest_image_create (store): query key key = _mgs._tcp
139432025-04-30T06:30:15.448ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
139442025-04-30T06:30:15.448ZDEBGtest_image_create (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] kind = dns peer_addr = [::1]:59295 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") })) }] req_id = 352f2422-e3cd-4c14-a866-c31454c425ed
139452025-04-30T06:30:15.449ZDEBGtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 54825, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }], valid_until: Instant { tv_sec: 3480, tv_nsec: 248225681 } })
139462025-04-30T06:30:15.449ZTRACtest_image_create (DnsResolver): lookup_service_targets: looking up SRV target
139472025-04-30T06:30:15.449ZTRACtest_image_create (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 8a 28 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .(..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:54799 req_id = df541de1-e41d-4174-a87b-4836665207be
139482025-04-30T06:30:15.450ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 35368,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:54799 req_id = df541de1-e41d-4174-a87b-4836665207be
139492025-04-30T06:30:15.450ZDEBGtest_image_create (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
139502025-04-30T06:30:15.451ZDEBGtest_image_create (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:54799 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(::1))) }] req_id = df541de1-e41d-4174-a87b-4836665207be
139512025-04-30T06:30:15.525ZTRACtest_image_create (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
139522025-04-30T06:30:15.526ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
139532025-04-30T06:30:15.526ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
139542025-04-30T06:30:15.526ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
139552025-04-30T06:30:15.526ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
139562025-04-30T06:30:15.527ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
139572025-04-30T06:30:15.527ZDEBGtest_image_create (results-sink): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
139582025-04-30T06:30:15.527ZDEBGtest_image_create (results-sink-cluster): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
139592025-04-30T06:30:15.528ZDEBGtest_image_create (clickhouse-client): unrolling 2 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc
139602025-04-30T06:30:15.530ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
139612025-04-30T06:30:15.531ZTRACtest_image_create (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: b2 b2 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:51509 req_id = 81db4fb0-cdf5-425b-b29f-019fbbd11de4
139622025-04-30T06:30:15.531ZDEBGtest_image_create (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45746,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} peer_addr = [::1]:51509 req_id = 81db4fb0-cdf5-425b-b29f-019fbbd11de4
139632025-04-30T06:30:15.531ZDEBGtest_image_create (store): query key key = _clickhouse-admin-keeper._tcp
139642025-04-30T06:30:15.531ZERROtest_image_create (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45746, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:51509 req_id = 81db4fb0-cdf5-425b-b29f-019fbbd11de4
139652025-04-30T06:30:15.533ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139662025-04-30T06:30:15.540ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
139672025-04-30T06:30:15.540ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
139682025-04-30T06:30:15.540ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
139692025-04-30T06:30:15.540ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
139702025-04-30T06:30:15.541ZDEBGtest_image_create (BackgroundTasks): begin collection background_task = inventory_collection
139712025-04-30T06:30:15.541ZDEBGtest_image_create (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:54825
139722025-04-30T06:30:15.541ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/ignition
139732025-04-30T06:30:15.545ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = fields_string
139742025-04-30T06:30:15.545ZTRACtest_image_create (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
139752025-04-30T06:30:15.545ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
139762025-04-30T06:30:15.545ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
139772025-04-30T06:30:15.546ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
139782025-04-30T06:30:15.560ZDEBGtest_image_create (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 076c57a5-6e9f-4a58-9a28-cc536206f9bc n_rows = 2 table_name = measurements_i64
139792025-04-30T06:30:15.560ZTRACtest_image_create (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
139802025-04-30T06:30:15.580ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3939e34-cfed-4a1f-9a7e-aa79f9dfb119", "content-length": "835", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139812025-04-30T06:30:15.581ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0
139822025-04-30T06:30:15.595ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0db80a69-f5fb-4752-a30a-fc7b6e4dcbb8", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139832025-04-30T06:30:15.596ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0
139842025-04-30T06:30:15.611ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b54fb57d-02a9-4976-895f-69bfc574db6e", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139852025-04-30T06:30:15.611ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1
139862025-04-30T06:30:15.618ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "65480b2f-266e-4942-a2d2-a7d7b73be306", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139872025-04-30T06:30:15.618ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0
139882025-04-30T06:30:15.618ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
139892025-04-30T06:30:15.622ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3c54819-f956-4a79-a771-789efe465811", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139902025-04-30T06:30:15.623ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1
139912025-04-30T06:30:15.626ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "21c1bc6d-5ffe-4b4a-83e8-e1e5aa7de9d9", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139922025-04-30T06:30:15.626ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0
139932025-04-30T06:30:15.628ZWARNtest_image_create (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
139942025-04-30T06:30:15.629ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "db52af86-9ea4-4283-8197-a11e3083534d", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139952025-04-30T06:30:15.630ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1
139962025-04-30T06:30:15.633ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97e968d2-ed93-4b69-b9f1-1c72ae53281a", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139972025-04-30T06:30:15.634ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cmpa
139982025-04-30T06:30:15.635ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccc20635-c253-47ac-b708-46a9f64a1df0", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
139992025-04-30T06:30:15.635ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
140002025-04-30T06:30:15.636ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8094927-dad4-4ee1-9bcd-9fdd53791342", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140012025-04-30T06:30:15.636ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
140022025-04-30T06:30:15.638ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "be367e40-93e4-44db-8ccd-bb1dbfb8e2e3", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140032025-04-30T06:30:15.638ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/0/component/rot/cfpa
140042025-04-30T06:30:15.641ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f66ace16-2e8e-4cea-b314-63ddb0c085b4", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140052025-04-30T06:30:15.641ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1
140062025-04-30T06:30:15.644ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e7ce98b-f3cc-4cc3-bf0b-bb1eecd718ce", "content-length": "734", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140072025-04-30T06:30:15.645ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0
140082025-04-30T06:30:15.650ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a57cf6a-9742-4aa9-9391-7c5e83b86987", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140092025-04-30T06:30:15.651ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1
140102025-04-30T06:30:15.658ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6062845e-e924-4fb4-b9ac-a1193b474134", "content-length": "111", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140112025-04-30T06:30:15.658ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0
140122025-04-30T06:30:15.662ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "89877d17-7aa5-4d8d-88e6-0e16562ffd39", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140132025-04-30T06:30:15.662ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1
140142025-04-30T06:30:15.668ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "95a1bc3f-b624-4411-8155-d87e5ab71182", "content-length": "170", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140152025-04-30T06:30:15.668ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0
140162025-04-30T06:30:15.670ZTRACtest_image_create (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory
140172025-04-30T06:30:15.670ZTRACtest_image_create (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
140182025-04-30T06:30:15.670ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
140192025-04-30T06:30:15.670ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
140202025-04-30T06:30:15.671ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
140212025-04-30T06:30:15.674ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140222025-04-30T06:30:15.683ZDEBGtest_image_create (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Inventory result = Ok(())
140232025-04-30T06:30:15.683ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
140242025-04-30T06:30:15.683ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
140252025-04-30T06:30:15.684ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
140262025-04-30T06:30:15.687ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64bf6cf4-0a20-4de9-b932-e3df862e9e53", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140272025-04-30T06:30:15.687ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1
140282025-04-30T06:30:15.689ZTRACtest_image_create (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database
140292025-04-30T06:30:15.689ZDEBGtest_image_create (InternalApi): roles roles = RoleSet { roles: {} }
140302025-04-30T06:30:15.690ZDEBGtest_image_create (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
140312025-04-30T06:30:15.699ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c8d9cf5-4be9-45a1-b8eb-7cf7e8c047f2", "content-length": "179", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140322025-04-30T06:30:15.699ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cmpa
140332025-04-30T06:30:15.703ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "314fffe4-5778-49c1-b6c3-b99eb64fd263", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140342025-04-30T06:30:15.703ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
140352025-04-30T06:30:15.706ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dfbbe6e-bdcd-473a-8af2-cdb4f79ed4a5", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140362025-04-30T06:30:15.706ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
140372025-04-30T06:30:15.708ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "81631b14-9128-4acb-9764-9eed7deda37e", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140382025-04-30T06:30:15.708ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/switch/1/component/rot/cfpa
140392025-04-30T06:30:15.713ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc906045-c023-40e2-9550-760a1b900a77", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140402025-04-30T06:30:15.713ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0
140412025-04-30T06:30:15.717ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f060649f-35e1-4150-bd69-d4cadad3e959", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140422025-04-30T06:30:15.717ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0
140432025-04-30T06:30:15.737ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fecef013-46c3-4d64-ae8b-9ab11cdf03a7", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140442025-04-30T06:30:15.738ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1
140452025-04-30T06:30:15.742ZDEBGtest_image_create: attempt to fetch latest inventory collection result = Ok("found")
140462025-04-30T06:30:15.747ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "34b6208c-ad9a-41fc-ab99-b5550a5d68bd", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140472025-04-30T06:30:15.747ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0
140482025-04-30T06:30:15.751ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "29fa917a-b405-4a74-bdff-2ecb5a668ba4", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140492025-04-30T06:30:15.751ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1
140502025-04-30T06:30:15.753ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "92055f3a-6884-42a1-a63b-c9445ec95c86", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140512025-04-30T06:30:15.753ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0
140522025-04-30T06:30:15.756ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f578814a-4fc8-4163-9180-f755dfab6858", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140532025-04-30T06:30:15.756ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1
140542025-04-30T06:30:15.759ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b59884f1-ddf9-4662-a83f-7703e8e9aaa5", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140552025-04-30T06:30:15.760ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cmpa
140562025-04-30T06:30:15.761ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "faacfe15-eea2-425d-b119-759a1b03cee1", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140572025-04-30T06:30:15.761ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
140582025-04-30T06:30:15.762ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0898783-be14-4db8-a110-6af034b7a230", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140592025-04-30T06:30:15.762ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
140602025-04-30T06:30:15.763ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eec86ef-4779-4e5f-87af-d83c9dbe739d", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140612025-04-30T06:30:15.763ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/0/component/rot/cfpa
140622025-04-30T06:30:15.765ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d74bafb-b81f-4fb3-87e0-f25097c954a7", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140632025-04-30T06:30:15.765ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1
140642025-04-30T06:30:15.766ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8124796-ef9a-4424-846d-ce4db8dfe561", "content-length": "723", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140652025-04-30T06:30:15.766ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0
140662025-04-30T06:30:15.768ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e818c329-d3a2-44ba-90da-f4b5fb36c201", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140672025-04-30T06:30:15.769ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1
140682025-04-30T06:30:15.771ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af7405d0-5495-448e-88a0-e79ea4c19f4f", "content-length": "109", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140692025-04-30T06:30:15.771ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0
140702025-04-30T06:30:15.775ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "38e65646-0f77-455c-8a72-3b7fe930081e", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140712025-04-30T06:30:15.775ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1
140722025-04-30T06:30:15.776ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "08d29fa1-20db-4ef6-89ba-5be9bb565579", "content-length": "169", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140732025-04-30T06:30:15.776ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0
140742025-04-30T06:30:15.778ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e491194c-8f53-4625-b942-6c78a95f9564", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140752025-04-30T06:30:15.778ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1
140762025-04-30T06:30:15.780ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7274a0d-2031-41c7-99c0-aea332e80703", "content-length": "178", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140772025-04-30T06:30:15.780ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cmpa
140782025-04-30T06:30:15.781ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c262acf-5092-4274-b9b2-e347b680277d", "content-length": "702", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140792025-04-30T06:30:15.781ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
140802025-04-30T06:30:15.783ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d45e3009-5a6c-4ee7-91a2-62aa9da9000a", "content-length": "727", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140812025-04-30T06:30:15.783ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
140822025-04-30T06:30:15.784ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7502e4dd-7b6a-4af4-b94c-d22f8d10b928", "content-length": "729", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140832025-04-30T06:30:15.785ZDEBGtest_image_create (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:54825 method = GET uri = http://[::1]:54825/sp/sled/1/component/rot/cfpa
140842025-04-30T06:30:15.786ZDEBGtest_image_create (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:54825 result = Ok(Response { url: "http://[::1]:54825/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c7864e-1574-4d66-a0aa-14c1db420ec1", "content-length": "728", "date": "Wed, 30 Apr 2025 06:30:14 GMT"} })
140852025-04-30T06:30:15.786ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
140862025-04-30T06:30:15.786ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
140872025-04-30T06:30:15.786ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
140882025-04-30T06:30:15.786ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
140892025-04-30T06:30:15.787ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
140902025-04-30T06:30:15.789ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140912025-04-30T06:30:15.797ZDEBGtest_image_create (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
140922025-04-30T06:30:15.797ZTRACtest_image_create (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet
140932025-04-30T06:30:15.797ZTRACtest_image_create (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
140942025-04-30T06:30:15.797ZTRACtest_image_create (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database
140952025-04-30T06:30:15.797ZDEBGtest_image_create (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
140962025-04-30T06:30:15.798ZDEBGtest_image_create (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())