Max level shown:
1 [ Jan 13 09:32:21 Enabled. ]
2 [ Jan 13 09:32:21 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 13 09:32:21 Method "start" exited with status 0. ]
4 [ Jan 13 09:32:21 Rereading configuration. ]
5 [ Jan 13 09:32:21 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-13T09:32:21.468ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-13T09:32:21.468ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-13T09:32:21.521ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-13T09:32:21.521ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-13T09:32:21.636ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-13T09:32:21.645ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-13T09:32:21.652ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-13T09:32:22.253ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-13T09:32:22.390ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-13T09:32:22.390ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-13T09:32:22.390ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-13T09:32:22.390ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-13T09:32:22.390ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-13T09:32:22.390ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-13T09:32:22.393ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-13T09:32:22.393ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-13T09:32:22.393ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-13T09:32:22.393ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-13T09:32:22.393ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-13T09:32:22.393ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-13T09:32:22.393ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-13T09:32:22.393ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-13T09:32:22.393ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-13T09:32:22.405ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-13T09:32:22.405ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool)
322025-01-13T09:32:22.500ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal }
332025-01-13T09:32:22.860ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-13T09:32:22.860ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-13T09:32:22.860ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-13T09:32:22.860ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-13T09:32:22.860ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-13T09:32:22.860ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-13T09:32:22.860ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-13T09:32:22.868ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-13T09:32:22.868ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool)
422025-01-13T09:32:22.955ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal }
432025-01-13T09:32:23.315ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-13T09:32:23.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-13T09:32:23.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-13T09:32:23.316ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-13T09:32:23.316ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-13T09:32:23.316ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-13T09:32:23.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1012025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-13T09:32:23.316ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-13T09:32:23.316ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-13T09:32:23.316ZINFOSledAgent (bootstore): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-13T09:32:23.316ZINFOSledAgent (bootstore): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-13T09:32:23.316ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-13T09:32:23.316ZINFOSledAgent (bootstore): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-13T09:32:23.316ZINFOSledAgent (bootstore): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-13T09:32:23.316ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-13T09:32:23.316ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-13T09:32:23.316ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-13T09:32:23.327ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-13T09:32:23.328ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4653, tv_nsec: 557865501 } time_to_next_cleanup = 599.999951988s
1142025-01-13T09:32:23.328ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-13T09:32:23.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-13T09:32:23.328ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-13T09:32:23.328ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-13T09:32:23.330ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-13T09:32:23.332ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-13T09:32:23.332ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-13T09:32:23.332ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-13T09:32:23.332ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-13T09:32:23.332ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-13T09:32:23.332ZINFOSledAgent (RSS): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-13T09:32:23.332ZINFOSledAgent (RSS): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-13T09:32:23.332ZINFOSledAgent (RSS): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-13T09:32:23.332ZINFOSledAgent (RSS): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-13T09:32:23.332ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-13T09:32:23.332ZINFOSledAgent (RSS): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-13T09:32:23.333ZINFOSledAgent (RSS): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-13T09:32:23.333ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-13T09:32:23.333ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-13T09:32:23.333ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-13T09:32:23.333ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-13T09:32:23.333ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-13T09:32:23.333ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-13T09:32:23.333ZINFOSledAgent (bootstore): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-13T09:32:23.333ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-13T09:32:23.333ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 23b0ec58-d6f5-4744-a480-2ff78825ad63 (sled), rack_id: 1870dbb3-0b63-4064-8b75-d13052a6b844, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-13T09:32:23.334ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-13T09:32:23.334ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-13T09:32:23.338ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-13T09:32:23.343ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-13T09:32:23.343ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-13T09:32:23.347ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-13T09:32:23.347ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-13T09:32:23.347ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:46457
1482025-01-13T09:32:23.348ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 23b0ec58-d6f5-4744-a480-2ff78825ad63 (sled), rack_id: 1870dbb3-0b63-4064-8b75-d13052a6b844, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-13T09:32:23.348ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-13T09:32:23.348ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-13T09:32:23.348ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-13T09:32:23.348ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-13T09:32:23.348ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-13T09:32:23.348ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-13T09:32:23.362ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-13T09:32:23.380ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-13T09:32:23.396ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-13T09:32:23.408ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1662025-01-13T09:32:23.408ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-13T09:32:23.408ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1682025-01-13T09:32:23.408ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-13T09:32:23.411ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 63.110317ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b0f1f3b1-237f-4860-a612-f800da8b8592", "content-length": "124", "date": "Mon, 13 Jan 2025 09:32:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b0f1f3b1-237f-4860-a612-f800da8b8592" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-13T09:32:23.422ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_4296f26d-263a-457b-8da9-fc9ac9718289/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-13T09:32:23.444ZINFOSledAgent: successfully created encrypted zvol: name="oxi_4296f26d-263a-457b-8da9-fc9ac9718289/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-13T09:32:23.444ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_4296f26d-263a-457b-8da9-fc9ac9718289/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-13T09:32:23.450ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1742025-01-13T09:32:23.450ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-13T09:32:23.450ZINFOSledAgent (BackingFs): Ensuring dataset oxi_4296f26d-263a-457b-8da9-fc9ac9718289/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-13T09:32:23.475ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-13T09:32:23.475ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 114.712389ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "38218c38-fb31-4672-b9e2-3c803a452e19", "content-length": "124", "date": "Mon, 13 Jan 2025 09:32:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "38218c38-fb31-4672-b9e2-3c803a452e19" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-13T09:32:23.519ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-13T09:32:23.591ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-13T09:32:23.592ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.620344ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fda9150d-33ae-4aa0-b089-584a9913f08f", "content-length": "124", "date": "Mon, 13 Jan 2025 09:32:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fda9150d-33ae-4aa0-b089-584a9913f08f" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-13T09:32:23.697ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822025-01-13T09:32:23.697ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 94.892086ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "275ac6bf-972a-4449-9b6c-0ed5eb753699", "content-length": "124", "date": "Mon, 13 Jan 2025 09:32:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "275ac6bf-972a-4449-9b6c-0ed5eb753699" } file = clients/ddm-admin-client/src/lib.rs:177
1832025-01-13T09:32:23.738ZINFOSledAgent (BackingFs): Mounting oxi_4296f26d-263a-457b-8da9-fc9ac9718289/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-01-13T09:32:23.751ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-01-13T09:32:23.751ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-01-13T09:32:23.751ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-01-13T09:32:23.751ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-01-13T09:32:23.793ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-13T09:32:23.794ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 295.718259ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0ad99cde-46c8-4a99-a753-400838c2a296", "content-length": "124", "date": "Mon, 13 Jan 2025 09:32:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0ad99cde-46c8-4a99-a753-400838c2a296" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-13T09:32:24.090ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-13T09:32:24.091ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 303.960766ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "58d51d84-021f-42e6-83f7-4515c4c0f4d9", "content-length": "124", "date": "Mon, 13 Jan 2025 09:32:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "58d51d84-021f-42e6-83f7-4515c4c0f4d9" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-13T09:32:24.396ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-13T09:32:24.397ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 442.19374ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9f9a7422-a0fe-474e-8270-4c74f0e4a198", "content-length": "124", "date": "Mon, 13 Jan 2025 09:32:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9f9a7422-a0fe-474e-8270-4c74f0e4a198" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-13T09:32:24.482ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1952025-01-13T09:32:24.488ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:51883 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1962025-01-13T09:32:24.488ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1972025-01-13T09:32:24.488ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:51883 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1982025-01-13T09:32:24.489ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 281.373899ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
1992025-01-13T09:32:24.490ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2002025-01-13T09:32:24.490ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2012025-01-13T09:32:24.490ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2022025-01-13T09:32:24.490ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-13T09:32:24.772ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 486.579464ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2042025-01-13T09:32:24.840ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052025-01-13T09:32:25.260ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 661.772597ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2062025-01-13T09:32:25.924ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.972280711s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2072025-01-13T09:32:27.061ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2082025-01-13T09:32:27.061ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2092025-01-13T09:32:27.061ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2102025-01-13T09:32:27.061ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2112025-01-13T09:32:27.061ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2122025-01-13T09:32:27.061ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2132025-01-13T09:32:27.063ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2142025-01-13T09:32:27.065ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2152025-01-13T09:32:27.065ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='98e7e480-8914-437c-aaa2-2513fa72b166'/> <propval type="astring" name="rack_id" value='1870dbb3-0b63-4064-8b75-d13052a6b844'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe7c:7f10'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='1870dbb3-0b63-4064-8b75-d13052a6b844'/> <propval type="astring" name="sled_id" value='23b0ec58-d6f5-4744-a480-2ff78825ad63'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='23b0ec58-d6f5-4744-a480-2ff78825ad63'/> <propval type="astring" name="rack_uuid" value='1870dbb3-0b63-4064-8b75-d13052a6b844'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='23b0ec58-d6f5-4744-a480-2ff78825ad63'/> <propval type="astring" name="rack_uuid" value='1870dbb3-0b63-4064-8b75-d13052a6b844'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-13T09:32:27.065ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-13T09:32:27.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 64.698154ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-13T09:32:27.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 121.836166ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-13T09:32:27.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 296.642798ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-13T09:32:28.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 309.397426ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212025-01-13T09:32:28.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 996.197448ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-13T09:32:28.897ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.482815512s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2232025-01-13T09:32:29.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 577.303282ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-13T09:32:30.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 914.114947ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-13T09:32:31.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 950.361309ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262025-01-13T09:32:31.439ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.777500864s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2272025-01-13T09:32:32.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 534.763807ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282025-01-13T09:32:33.639ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/nexus.rs:527 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2292025-01-13T09:32:33.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-01-13T09:32:33.670ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2312025-01-13T09:32:33.671ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2322025-01-13T09:32:33.671ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332025-01-13T09:32:33.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2342025-01-13T09:32:33.671ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-13T09:32:33.671ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362025-01-13T09:32:33.672ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372025-01-13T09:32:33.672ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382025-01-13T09:32:33.672ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2392025-01-13T09:32:33.672ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:46457
2402025-01-13T09:32:33.894ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2412025-01-13T09:32:33.894ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2422025-01-13T09:32:33.899ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432025-01-13T09:32:34.566ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2442025-01-13T09:32:34.567ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 929312412178090425 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2452025-01-13T09:32:34.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8337928307870898799 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2462025-01-13T09:32:34.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45401
2472025-01-13T09:32:34.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2482025-01-13T09:32:34.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492025-01-13T09:32:34.582ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:188
2502025-01-13T09:32:34.582ZINFOSledAgent (ServiceManager): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:188
2512025-01-13T09:32:34.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45401 req_id = f7236b08-96dd-4b17-aab1-1ed19b01b787 response_code = 200 uri = /inventory
2522025-01-13T09:32:34.595ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2532025-01-13T09:32:34.595ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2542025-01-13T09:32:34.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51516
2552025-01-13T09:32:34.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51516 req_id = 766728ed-45d0-4fc2-a736-6a32f32cabfe response_code = 200 uri = /sled-role
2562025-01-13T09:32:34.674ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2572025-01-13T09:32:34.676ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 0c08a658-ca6d-4711-8a5d-11ccdb2a14e7 (physical_disk), pool_id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 4e9d4111-7564-45f9-856a-01790305877c (physical_disk), pool_id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cfecd64c-4bc9-4c4a-b8ba-25e1a24c7180 (physical_disk), pool_id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: fa5ac832-3b41-4ae0-92ea-b24daf349a83 (physical_disk), pool_id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b1d6325f-1b70-477b-a888-1d8c03056d4d (physical_disk), pool_id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 4dad10ee-3977-47bf-bc82-6a3b936cd0d0 (physical_disk), pool_id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d889b7fe-0557-4f56-8d0c-1aec814d7172 (physical_disk), pool_id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: adcda908-01de-4c27-a50c-7af1987fb157 (physical_disk), pool_id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: f795ad68-e79e-4b14-99e4-f05761ceaef5 (physical_disk), pool_id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2582025-01-13T09:32:34.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65172
2592025-01-13T09:32:34.677ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
2602025-01-13T09:32:34.677ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 0c08a658-ca6d-4711-8a5d-11ccdb2a14e7 (physical_disk), pool_id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 4e9d4111-7564-45f9-856a-01790305877c (physical_disk), pool_id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cfecd64c-4bc9-4c4a-b8ba-25e1a24c7180 (physical_disk), pool_id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: fa5ac832-3b41-4ae0-92ea-b24daf349a83 (physical_disk), pool_id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b1d6325f-1b70-477b-a888-1d8c03056d4d (physical_disk), pool_id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 4dad10ee-3977-47bf-bc82-6a3b936cd0d0 (physical_disk), pool_id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d889b7fe-0557-4f56-8d0c-1aec814d7172 (physical_disk), pool_id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: adcda908-01de-4c27-a50c-7af1987fb157 (physical_disk), pool_id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: f795ad68-e79e-4b14-99e4-f05761ceaef5 (physical_disk), pool_id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2612025-01-13T09:32:34.677ZINFOSledAgent (StorageManager): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2622025-01-13T09:32:34.677ZINFOSledAgent (StorageManager): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2632025-01-13T09:32:34.677ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2642025-01-13T09:32:34.677ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2652025-01-13T09:32:34.677ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2662025-01-13T09:32:34.677ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2672025-01-13T09:32:34.677ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2682025-01-13T09:32:34.688ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2692025-01-13T09:32:34.688ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool)
2702025-01-13T09:32:34.737ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
2712025-01-13T09:32:34.737ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
2722025-01-13T09:32:34.779ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
2732025-01-13T09:32:34.779ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
2742025-01-13T09:32:34.797ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }
2752025-01-13T09:32:34.806ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2762025-01-13T09:32:34.806ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2772025-01-13T09:32:34.806ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2782025-01-13T09:32:34.806ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2792025-01-13T09:32:34.806ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2802025-01-13T09:32:34.806ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2812025-01-13T09:32:34.806ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2822025-01-13T09:32:34.833ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
2832025-01-13T09:32:34.833ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
2842025-01-13T09:32:34.847ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2852025-01-13T09:32:34.853ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
2862025-01-13T09:32:34.853ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
2872025-01-13T09:32:34.856ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone file = sled-storage/src/dataset.rs:302
2882025-01-13T09:32:34.926ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
2892025-01-13T09:32:34.926ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
2902025-01-13T09:32:35.005ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605 file = sled-storage/src/dataset.rs:388
2912025-01-13T09:32:35.013ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2922025-01-13T09:32:35.013ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2932025-01-13T09:32:35.013ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2942025-01-13T09:32:35.013ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2952025-01-13T09:32:35.013ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2962025-01-13T09:32:35.023ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2972025-01-13T09:32:35.023ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool)
2982025-01-13T09:32:35.118ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }
2992025-01-13T09:32:35.125ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
3002025-01-13T09:32:35.125ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
3012025-01-13T09:32:35.125ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
3022025-01-13T09:32:35.125ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
3032025-01-13T09:32:35.125ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3042025-01-13T09:32:35.126ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3052025-01-13T09:32:35.126ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3062025-01-13T09:32:35.162ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3072025-01-13T09:32:35.170ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone file = sled-storage/src/dataset.rs:302
3082025-01-13T09:32:35.306ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98 file = sled-storage/src/dataset.rs:388
3092025-01-13T09:32:35.313ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3102025-01-13T09:32:35.313ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3112025-01-13T09:32:35.313ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3122025-01-13T09:32:35.313ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3132025-01-13T09:32:35.313ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3142025-01-13T09:32:35.323ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3152025-01-13T09:32:35.323ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool)
3162025-01-13T09:32:35.417ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }
3172025-01-13T09:32:35.425ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3182025-01-13T09:32:35.425ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3192025-01-13T09:32:35.425ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3202025-01-13T09:32:35.425ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3212025-01-13T09:32:35.425ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3222025-01-13T09:32:35.425ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3232025-01-13T09:32:35.425ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3242025-01-13T09:32:35.459ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3252025-01-13T09:32:35.467ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone file = sled-storage/src/dataset.rs:302
3262025-01-13T09:32:35.604ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c file = sled-storage/src/dataset.rs:388
3272025-01-13T09:32:35.612ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3282025-01-13T09:32:35.612ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3292025-01-13T09:32:35.612ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3302025-01-13T09:32:35.612ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3312025-01-13T09:32:35.612ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3322025-01-13T09:32:35.622ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3332025-01-13T09:32:35.622ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool)
3342025-01-13T09:32:35.716ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }
3352025-01-13T09:32:35.725ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3362025-01-13T09:32:35.725ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3372025-01-13T09:32:35.725ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3382025-01-13T09:32:35.725ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3392025-01-13T09:32:35.725ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3402025-01-13T09:32:35.725ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3412025-01-13T09:32:35.725ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3422025-01-13T09:32:35.729ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
3432025-01-13T09:32:35.760ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3442025-01-13T09:32:35.768ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crypt/zone file = sled-storage/src/dataset.rs:302
3452025-01-13T09:32:35.906ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_22bc846d-e6cf-469c-acea-15b83ef27270 file = sled-storage/src/dataset.rs:388
3462025-01-13T09:32:35.914ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3472025-01-13T09:32:35.914ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3482025-01-13T09:32:35.914ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3492025-01-13T09:32:35.914ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3502025-01-13T09:32:35.914ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3512025-01-13T09:32:35.924ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3522025-01-13T09:32:35.924ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool)
3532025-01-13T09:32:36.017ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }
3542025-01-13T09:32:36.026ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3552025-01-13T09:32:36.026ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3562025-01-13T09:32:36.026ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3572025-01-13T09:32:36.026ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3582025-01-13T09:32:36.026ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3592025-01-13T09:32:36.026ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3602025-01-13T09:32:36.026ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3612025-01-13T09:32:36.061ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3622025-01-13T09:32:36.069ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone file = sled-storage/src/dataset.rs:302
3632025-01-13T09:32:36.208ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2 file = sled-storage/src/dataset.rs:388
3642025-01-13T09:32:36.216ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3652025-01-13T09:32:36.216ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3662025-01-13T09:32:36.216ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3672025-01-13T09:32:36.217ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3682025-01-13T09:32:36.217ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3692025-01-13T09:32:36.225ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3702025-01-13T09:32:36.225ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool)
3712025-01-13T09:32:36.321ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }
3722025-01-13T09:32:36.329ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3732025-01-13T09:32:36.329ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3742025-01-13T09:32:36.329ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3752025-01-13T09:32:36.329ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3762025-01-13T09:32:36.329ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3772025-01-13T09:32:36.330ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3782025-01-13T09:32:36.330ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3792025-01-13T09:32:36.365ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3802025-01-13T09:32:36.373ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/zone file = sled-storage/src/dataset.rs:302
3812025-01-13T09:32:36.508ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c file = sled-storage/src/dataset.rs:388
3822025-01-13T09:32:36.516ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3832025-01-13T09:32:36.516ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3842025-01-13T09:32:36.516ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3852025-01-13T09:32:36.516ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3862025-01-13T09:32:36.516ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3872025-01-13T09:32:36.525ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3882025-01-13T09:32:36.525ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool)
3892025-01-13T09:32:36.623ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }
3902025-01-13T09:32:36.631ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3912025-01-13T09:32:36.631ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3922025-01-13T09:32:36.631ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3932025-01-13T09:32:36.631ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3942025-01-13T09:32:36.631ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3952025-01-13T09:32:36.631ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3962025-01-13T09:32:36.631ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3972025-01-13T09:32:36.665ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3982025-01-13T09:32:36.673ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/zone file = sled-storage/src/dataset.rs:302
3992025-01-13T09:32:36.731ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4002025-01-13T09:32:36.811ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 file = sled-storage/src/dataset.rs:388
4012025-01-13T09:32:36.819ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4022025-01-13T09:32:36.819ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4032025-01-13T09:32:36.819ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4042025-01-13T09:32:36.819ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4052025-01-13T09:32:36.819ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4062025-01-13T09:32:36.829ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4072025-01-13T09:32:36.829ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool)
4082025-01-13T09:32:36.930ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }
4092025-01-13T09:32:36.936ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4102025-01-13T09:32:36.936ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4112025-01-13T09:32:36.936ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4122025-01-13T09:32:36.937ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4132025-01-13T09:32:36.937ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4142025-01-13T09:32:36.937ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4152025-01-13T09:32:36.937ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4162025-01-13T09:32:36.971ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4172025-01-13T09:32:36.978ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/zone file = sled-storage/src/dataset.rs:302
4182025-01-13T09:32:37.120ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd file = sled-storage/src/dataset.rs:388
4192025-01-13T09:32:37.129ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4202025-01-13T09:32:37.129ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4212025-01-13T09:32:37.129ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4222025-01-13T09:32:37.129ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4232025-01-13T09:32:37.129ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4242025-01-13T09:32:37.138ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4252025-01-13T09:32:37.138ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool)
4262025-01-13T09:32:37.235ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }
4272025-01-13T09:32:37.243ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4282025-01-13T09:32:37.243ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4292025-01-13T09:32:37.243ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4302025-01-13T09:32:37.243ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4312025-01-13T09:32:37.243ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4322025-01-13T09:32:37.243ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4332025-01-13T09:32:37.243ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4342025-01-13T09:32:37.280ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4352025-01-13T09:32:37.288ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone file = sled-storage/src/dataset.rs:302
4362025-01-13T09:32:37.426ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4 file = sled-storage/src/dataset.rs:388
4372025-01-13T09:32:37.439ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4382025-01-13T09:32:37.439ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4392025-01-13T09:32:37.439ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4402025-01-13T09:32:37.439ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4296f26d-263a-457b-8da9-fc9ac9718289 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: abb1fad1-12b8-4ada-86f9-9b719a4f6748 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4412025-01-13T09:32:37.439ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4422025-01-13T09:32:37.439ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4432025-01-13T09:32:37.439ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4442025-01-13T09:32:37.439ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4452025-01-13T09:32:37.439ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4462025-01-13T09:32:37.439ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4472025-01-13T09:32:37.439ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4482025-01-13T09:32:37.439ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4492025-01-13T09:32:37.439ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4502025-01-13T09:32:37.439ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4512025-01-13T09:32:37.439ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4522025-01-13T09:32:37.439ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4532025-01-13T09:32:37.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762924 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:65172 req_id = 46d2ed45-94d7-42b9-93bd-c52ea816b34e response_code = 200 uri = /omicron-physical-disks
4542025-01-13T09:32:37.471ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {021bf795-a649-4608-a176-33fdd2fa0e7d (dataset): DatasetConfig { id: 021bf795-a649-4608-a176-33fdd2fa0e7d (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03acb884-e54d-4b97-92a7-5bc569880101 (dataset): DatasetConfig { id: 03acb884-e54d-4b97-92a7-5bc569880101 (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05606d74-9b8f-4bf6-8e47-837061cd917a (dataset): DatasetConfig { id: 05606d74-9b8f-4bf6-8e47-837061cd917a (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 059b7658-0409-4196-9ab4-15e6d492e7c7 (dataset): DatasetConfig { id: 059b7658-0409-4196-9ab4-15e6d492e7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0622a11a-57bb-4ffc-97f5-f9e2657a944f (dataset): DatasetConfig { id: 0622a11a-57bb-4ffc-97f5-f9e2657a944f (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b317a1c-4f96-4e0b-b602-f8a45b218f36 (dataset): DatasetConfig { id: 0b317a1c-4f96-4e0b-b602-f8a45b218f36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dd42cb5-cc4c-48b2-a059-e0e254853aa1 (dataset): DatasetConfig { id: 0dd42cb5-cc4c-48b2-a059-e0e254853aa1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e5e25b4-eb4c-4cfc-b985-a54ca09054ea (dataset): DatasetConfig { id: 0e5e25b4-eb4c-4cfc-b985-a54ca09054ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f7d2b9a-02d0-4091-870b-69e25da8a75b (dataset): DatasetConfig { id: 0f7d2b9a-02d0-4091-870b-69e25da8a75b (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 161c640a-1e24-4ba9-8707-338c15d29621 (dataset): DatasetConfig { id: 161c640a-1e24-4ba9-8707-338c15d29621 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1741ec70-ac74-403a-bc5f-dba24fb326f3 (dataset): DatasetConfig { id: 1741ec70-ac74-403a-bc5f-dba24fb326f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 186700b0-f307-41c8-a1b8-5fc7d143e56f (dataset): DatasetConfig { id: 186700b0-f307-41c8-a1b8-5fc7d143e56f (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 192528e8-dfca-4a32-a49f-14a55f7d42f8 (dataset): DatasetConfig { id: 192528e8-dfca-4a32-a49f-14a55f7d42f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 233eec1b-1a45-471b-b740-7919cc9cc8a8 (dataset): DatasetConfig { id: 233eec1b-1a45-471b-b740-7919cc9cc8a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28fc5a0d-7851-4db8-9502-39a01c3c49e8 (dataset): DatasetConfig { id: 28fc5a0d-7851-4db8-9502-39a01c3c49e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a4d4b3c-4f7d-486b-ae1d-0a5cd9f5ced5 (dataset): DatasetConfig { id: 2a4d4b3c-4f7d-486b-ae1d-0a5cd9f5ced5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a7b6949-e318-42ba-9b5c-0b5e9cf369aa (dataset): DatasetConfig { id: 2a7b6949-e318-42ba-9b5c-0b5e9cf369aa (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d0d9b02-223d-40e2-9a14-0b61063a4c1b (dataset): DatasetConfig { id: 2d0d9b02-223d-40e2-9a14-0b61063a4c1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33fedfaa-a9bc-488c-922c-fa1fe3159d5c (dataset): DatasetConfig { id: 33fedfaa-a9bc-488c-922c-fa1fe3159d5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39ace626-ad80-4082-9c4e-e148a7307cfb (dataset): DatasetConfig { id: 39ace626-ad80-4082-9c4e-e148a7307cfb (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4857263f-de22-40d6-a4c5-3ffedd01622b (dataset): DatasetConfig { id: 4857263f-de22-40d6-a4c5-3ffedd01622b (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 488ad58d-6fe3-4e35-913c-303da4d0f546 (dataset): DatasetConfig { id: 488ad58d-6fe3-4e35-913c-303da4d0f546 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c2af906-ba15-4880-a5c1-24fad210929c (dataset): DatasetConfig { id: 4c2af906-ba15-4880-a5c1-24fad210929c (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4de26d8e-a985-4952-99eb-e9e3685ad0be (dataset): DatasetConfig { id: 4de26d8e-a985-4952-99eb-e9e3685ad0be (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f2f05ae-b268-4394-8524-9569219a1850 (dataset): DatasetConfig { id: 4f2f05ae-b268-4394-8524-9569219a1850 (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f4ff937-a680-461a-b847-d3c651ae3326 (dataset): DatasetConfig { id: 4f4ff937-a680-461a-b847-d3c651ae3326 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5702db39-bd61-4295-b27b-d9847894475b (dataset): DatasetConfig { id: 5702db39-bd61-4295-b27b-d9847894475b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e30207d-2a00-4d1f-a78f-2d02b489e203 (dataset): DatasetConfig { id: 5e30207d-2a00-4d1f-a78f-2d02b489e203 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62400981-7dd5-460e-8dec-4a72b6c74717 (dataset): DatasetConfig { id: 62400981-7dd5-460e-8dec-4a72b6c74717 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69bcee9b-0520-43d7-9c74-903f3af47cac (dataset): DatasetConfig { id: 69bcee9b-0520-43d7-9c74-903f3af47cac (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e73137b-5999-435a-8f67-9c43c1aab1d7 (dataset): DatasetConfig { id: 6e73137b-5999-435a-8f67-9c43c1aab1d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7142b585-0ecc-4e8c-a86e-e5af2cbf94d7 (dataset): DatasetConfig { id: 7142b585-0ecc-4e8c-a86e-e5af2cbf94d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76586aae-ed4f-4dcc-970d-f4766a57b83d (dataset): DatasetConfig { id: 76586aae-ed4f-4dcc-970d-f4766a57b83d (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b7c43d9-684f-4bfe-b75c-cd644bdd6a0d (dataset): DatasetConfig { id: 7b7c43d9-684f-4bfe-b75c-cd644bdd6a0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7bb76b6f-03ec-4d4f-a89b-c75b2efc189a (dataset): DatasetConfig { id: 7bb76b6f-03ec-4d4f-a89b-c75b2efc189a (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cb8ba49-a8bd-46ef-9c6e-cb6e91389291 (dataset): DatasetConfig { id: 7cb8ba49-a8bd-46ef-9c6e-cb6e91389291 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e3ed3bf-e847-4249-a328-52df5d90a858 (dataset): DatasetConfig { id: 7e3ed3bf-e847-4249-a328-52df5d90a858 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8235c950-3655-4e0e-9195-97b8db6a9f0f (dataset): DatasetConfig { id: 8235c950-3655-4e0e-9195-97b8db6a9f0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84fac796-5e62-49a4-a381-b9d6512de1f0 (dataset): DatasetConfig { id: 84fac796-5e62-49a4-a381-b9d6512de1f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 898f76ac-4320-40b0-a461-4116a7851eee (dataset): DatasetConfig { id: 898f76ac-4320-40b0-a461-4116a7851eee (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8a35ffe3-d164-4239-a564-7f4e293d35b1 (dataset): DatasetConfig { id: 8a35ffe3-d164-4239-a564-7f4e293d35b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c907270-de5e-4161-9d6d-c4204fe4fdde (dataset): DatasetConfig { id: 8c907270-de5e-4161-9d6d-c4204fe4fdde (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e4b0101-ba08-46b3-9775-57bbbdabe0e7 (dataset): DatasetConfig { id: 8e4b0101-ba08-46b3-9775-57bbbdabe0e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8f2c54ae-c28f-4ac7-a72e-34f58598d946 (dataset): DatasetConfig { id: 8f2c54ae-c28f-4ac7-a72e-34f58598d946 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9beac48a-238b-4e23-9cb3-4477d3df910e (dataset): DatasetConfig { id: 9beac48a-238b-4e23-9cb3-4477d3df910e (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ef281dd-2d06-4218-83f5-21d0eb6a20d0 (dataset): DatasetConfig { id: 9ef281dd-2d06-4218-83f5-21d0eb6a20d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1a323f8-a08b-44f8-bc32-1ed683b1aeb0 (dataset): DatasetConfig { id: a1a323f8-a08b-44f8-bc32-1ed683b1aeb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a42b27b9-65c8-4282-8a9e-3147a4fe1ebf (dataset): DatasetConfig { id: a42b27b9-65c8-4282-8a9e-3147a4fe1ebf (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a42cd99b-6f54-46df-9af7-1e1c2b93b9fd (dataset): DatasetConfig { id: a42cd99b-6f54-46df-9af7-1e1c2b93b9fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5f7edd4-defa-47c9-af91-d6a3a2690ebc (dataset): DatasetConfig { id: a5f7edd4-defa-47c9-af91-d6a3a2690ebc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a96a6268-6039-4b94-8742-b755d34be205 (dataset): DatasetConfig { id: a96a6268-6039-4b94-8742-b755d34be205 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa36d1d5-9b5b-4aa8-9862-8ab46d6af761 (dataset): DatasetConfig { id: aa36d1d5-9b5b-4aa8-9862-8ab46d6af761 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aff55e3c-9549-4b1e-83a0-dd807ecfe2af (dataset): DatasetConfig { id: aff55e3c-9549-4b1e-83a0-dd807ecfe2af (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2ab9941-0e5b-49e2-a838-c0a5326b0023 (dataset): DatasetConfig { id: b2ab9941-0e5b-49e2-a838-c0a5326b0023 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2d717ba-54f4-4ce4-becf-d19cb4c548cf (dataset): DatasetConfig { id: b2d717ba-54f4-4ce4-becf-d19cb4c548cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1dea190-ead2-4b75-a0cc-e89dfac1fc7a (dataset): DatasetConfig { id: c1dea190-ead2-4b75-a0cc-e89dfac1fc7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3bbf16f-9928-47a0-a653-79386b4d37ef (dataset): DatasetConfig { id: c3bbf16f-9928-47a0-a653-79386b4d37ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf0eb826-a21b-46be-af00-d4430f3cf8b9 (dataset): DatasetConfig { id: cf0eb826-a21b-46be-af00-d4430f3cf8b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5b5a80c-a7c7-479b-90ee-c19d10b7b102 (dataset): DatasetConfig { id: d5b5a80c-a7c7-479b-90ee-c19d10b7b102 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d66a7ec4-6ae0-4ca4-846d-3607f2a0f297 (dataset): DatasetConfig { id: d66a7ec4-6ae0-4ca4-846d-3607f2a0f297 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8b4e99b-8ff9-4375-8d1e-95629e069979 (dataset): DatasetConfig { id: d8b4e99b-8ff9-4375-8d1e-95629e069979 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4d3c6c2-02fa-424f-ab91-eee8322ca879 (dataset): DatasetConfig { id: e4d3c6c2-02fa-424f-ab91-eee8322ca879 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed158eef-5a5a-48c0-a6e4-339198bd2937 (dataset): DatasetConfig { id: ed158eef-5a5a-48c0-a6e4-339198bd2937 (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef4159a9-3ea4-4952-aef7-dc9c39fbc278 (dataset): DatasetConfig { id: ef4159a9-3ea4-4952-aef7-dc9c39fbc278 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3103896-5295-4b11-b624-83281fb6e2e5 (dataset): DatasetConfig { id: f3103896-5295-4b11-b624-83281fb6e2e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa50e82d-ec74-48a3-8aa4-7a8d56ae5232 (dataset): DatasetConfig { id: fa50e82d-ec74-48a3-8aa4-7a8d56ae5232 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4552025-01-13T09:32:37.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44338
4562025-01-13T09:32:37.472ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4572025-01-13T09:32:37.472ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {021bf795-a649-4608-a176-33fdd2fa0e7d (dataset): DatasetConfig { id: 021bf795-a649-4608-a176-33fdd2fa0e7d (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03acb884-e54d-4b97-92a7-5bc569880101 (dataset): DatasetConfig { id: 03acb884-e54d-4b97-92a7-5bc569880101 (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05606d74-9b8f-4bf6-8e47-837061cd917a (dataset): DatasetConfig { id: 05606d74-9b8f-4bf6-8e47-837061cd917a (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 059b7658-0409-4196-9ab4-15e6d492e7c7 (dataset): DatasetConfig { id: 059b7658-0409-4196-9ab4-15e6d492e7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0622a11a-57bb-4ffc-97f5-f9e2657a944f (dataset): DatasetConfig { id: 0622a11a-57bb-4ffc-97f5-f9e2657a944f (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b317a1c-4f96-4e0b-b602-f8a45b218f36 (dataset): DatasetConfig { id: 0b317a1c-4f96-4e0b-b602-f8a45b218f36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dd42cb5-cc4c-48b2-a059-e0e254853aa1 (dataset): DatasetConfig { id: 0dd42cb5-cc4c-48b2-a059-e0e254853aa1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e5e25b4-eb4c-4cfc-b985-a54ca09054ea (dataset): DatasetConfig { id: 0e5e25b4-eb4c-4cfc-b985-a54ca09054ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f7d2b9a-02d0-4091-870b-69e25da8a75b (dataset): DatasetConfig { id: 0f7d2b9a-02d0-4091-870b-69e25da8a75b (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 161c640a-1e24-4ba9-8707-338c15d29621 (dataset): DatasetConfig { id: 161c640a-1e24-4ba9-8707-338c15d29621 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1741ec70-ac74-403a-bc5f-dba24fb326f3 (dataset): DatasetConfig { id: 1741ec70-ac74-403a-bc5f-dba24fb326f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 186700b0-f307-41c8-a1b8-5fc7d143e56f (dataset): DatasetConfig { id: 186700b0-f307-41c8-a1b8-5fc7d143e56f (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 192528e8-dfca-4a32-a49f-14a55f7d42f8 (dataset): DatasetConfig { id: 192528e8-dfca-4a32-a49f-14a55f7d42f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 233eec1b-1a45-471b-b740-7919cc9cc8a8 (dataset): DatasetConfig { id: 233eec1b-1a45-471b-b740-7919cc9cc8a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28fc5a0d-7851-4db8-9502-39a01c3c49e8 (dataset): DatasetConfig { id: 28fc5a0d-7851-4db8-9502-39a01c3c49e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a4d4b3c-4f7d-486b-ae1d-0a5cd9f5ced5 (dataset): DatasetConfig { id: 2a4d4b3c-4f7d-486b-ae1d-0a5cd9f5ced5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a7b6949-e318-42ba-9b5c-0b5e9cf369aa (dataset): DatasetConfig { id: 2a7b6949-e318-42ba-9b5c-0b5e9cf369aa (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d0d9b02-223d-40e2-9a14-0b61063a4c1b (dataset): DatasetConfig { id: 2d0d9b02-223d-40e2-9a14-0b61063a4c1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33fedfaa-a9bc-488c-922c-fa1fe3159d5c (dataset): DatasetConfig { id: 33fedfaa-a9bc-488c-922c-fa1fe3159d5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39ace626-ad80-4082-9c4e-e148a7307cfb (dataset): DatasetConfig { id: 39ace626-ad80-4082-9c4e-e148a7307cfb (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4857263f-de22-40d6-a4c5-3ffedd01622b (dataset): DatasetConfig { id: 4857263f-de22-40d6-a4c5-3ffedd01622b (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 488ad58d-6fe3-4e35-913c-303da4d0f546 (dataset): DatasetConfig { id: 488ad58d-6fe3-4e35-913c-303da4d0f546 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c2af906-ba15-4880-a5c1-24fad210929c (dataset): DatasetConfig { id: 4c2af906-ba15-4880-a5c1-24fad210929c (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4de26d8e-a985-4952-99eb-e9e3685ad0be (dataset): DatasetConfig { id: 4de26d8e-a985-4952-99eb-e9e3685ad0be (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f2f05ae-b268-4394-8524-9569219a1850 (dataset): DatasetConfig { id: 4f2f05ae-b268-4394-8524-9569219a1850 (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f4ff937-a680-461a-b847-d3c651ae3326 (dataset): DatasetConfig { id: 4f4ff937-a680-461a-b847-d3c651ae3326 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5702db39-bd61-4295-b27b-d9847894475b (dataset): DatasetConfig { id: 5702db39-bd61-4295-b27b-d9847894475b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e30207d-2a00-4d1f-a78f-2d02b489e203 (dataset): DatasetConfig { id: 5e30207d-2a00-4d1f-a78f-2d02b489e203 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62400981-7dd5-460e-8dec-4a72b6c74717 (dataset): DatasetConfig { id: 62400981-7dd5-460e-8dec-4a72b6c74717 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69bcee9b-0520-43d7-9c74-903f3af47cac (dataset): DatasetConfig { id: 69bcee9b-0520-43d7-9c74-903f3af47cac (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e73137b-5999-435a-8f67-9c43c1aab1d7 (dataset): DatasetConfig { id: 6e73137b-5999-435a-8f67-9c43c1aab1d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7142b585-0ecc-4e8c-a86e-e5af2cbf94d7 (dataset): DatasetConfig { id: 7142b585-0ecc-4e8c-a86e-e5af2cbf94d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76586aae-ed4f-4dcc-970d-f4766a57b83d (dataset): DatasetConfig { id: 76586aae-ed4f-4dcc-970d-f4766a57b83d (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b7c43d9-684f-4bfe-b75c-cd644bdd6a0d (dataset): DatasetConfig { id: 7b7c43d9-684f-4bfe-b75c-cd644bdd6a0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7bb76b6f-03ec-4d4f-a89b-c75b2efc189a (dataset): DatasetConfig { id: 7bb76b6f-03ec-4d4f-a89b-c75b2efc189a (dataset), name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cb8ba49-a8bd-46ef-9c6e-cb6e91389291 (dataset): DatasetConfig { id: 7cb8ba49-a8bd-46ef-9c6e-cb6e91389291 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e3ed3bf-e847-4249-a328-52df5d90a858 (dataset): DatasetConfig { id: 7e3ed3bf-e847-4249-a328-52df5d90a858 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8235c950-3655-4e0e-9195-97b8db6a9f0f (dataset): DatasetConfig { id: 8235c950-3655-4e0e-9195-97b8db6a9f0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84fac796-5e62-49a4-a381-b9d6512de1f0 (dataset): DatasetConfig { id: 84fac796-5e62-49a4-a381-b9d6512de1f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 898f76ac-4320-40b0-a461-4116a7851eee (dataset): DatasetConfig { id: 898f76ac-4320-40b0-a461-4116a7851eee (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8a35ffe3-d164-4239-a564-7f4e293d35b1 (dataset): DatasetConfig { id: 8a35ffe3-d164-4239-a564-7f4e293d35b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c907270-de5e-4161-9d6d-c4204fe4fdde (dataset): DatasetConfig { id: 8c907270-de5e-4161-9d6d-c4204fe4fdde (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e4b0101-ba08-46b3-9775-57bbbdabe0e7 (dataset): DatasetConfig { id: 8e4b0101-ba08-46b3-9775-57bbbdabe0e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8f2c54ae-c28f-4ac7-a72e-34f58598d946 (dataset): DatasetConfig { id: 8f2c54ae-c28f-4ac7-a72e-34f58598d946 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9beac48a-238b-4e23-9cb3-4477d3df910e (dataset): DatasetConfig { id: 9beac48a-238b-4e23-9cb3-4477d3df910e (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ef281dd-2d06-4218-83f5-21d0eb6a20d0 (dataset): DatasetConfig { id: 9ef281dd-2d06-4218-83f5-21d0eb6a20d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1a323f8-a08b-44f8-bc32-1ed683b1aeb0 (dataset): DatasetConfig { id: a1a323f8-a08b-44f8-bc32-1ed683b1aeb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a42b27b9-65c8-4282-8a9e-3147a4fe1ebf (dataset): DatasetConfig { id: a42b27b9-65c8-4282-8a9e-3147a4fe1ebf (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a42cd99b-6f54-46df-9af7-1e1c2b93b9fd (dataset): DatasetConfig { id: a42cd99b-6f54-46df-9af7-1e1c2b93b9fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5f7edd4-defa-47c9-af91-d6a3a2690ebc (dataset): DatasetConfig { id: a5f7edd4-defa-47c9-af91-d6a3a2690ebc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a96a6268-6039-4b94-8742-b755d34be205 (dataset): DatasetConfig { id: a96a6268-6039-4b94-8742-b755d34be205 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa36d1d5-9b5b-4aa8-9862-8ab46d6af761 (dataset): DatasetConfig { id: aa36d1d5-9b5b-4aa8-9862-8ab46d6af761 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aff55e3c-9549-4b1e-83a0-dd807ecfe2af (dataset): DatasetConfig { id: aff55e3c-9549-4b1e-83a0-dd807ecfe2af (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2ab9941-0e5b-49e2-a838-c0a5326b0023 (dataset): DatasetConfig { id: b2ab9941-0e5b-49e2-a838-c0a5326b0023 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2d717ba-54f4-4ce4-becf-d19cb4c548cf (dataset): DatasetConfig { id: b2d717ba-54f4-4ce4-becf-d19cb4c548cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1dea190-ead2-4b75-a0cc-e89dfac1fc7a (dataset): DatasetConfig { id: c1dea190-ead2-4b75-a0cc-e89dfac1fc7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3bbf16f-9928-47a0-a653-79386b4d37ef (dataset): DatasetConfig { id: c3bbf16f-9928-47a0-a653-79386b4d37ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf0eb826-a21b-46be-af00-d4430f3cf8b9 (dataset): DatasetConfig { id: cf0eb826-a21b-46be-af00-d4430f3cf8b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5b5a80c-a7c7-479b-90ee-c19d10b7b102 (dataset): DatasetConfig { id: d5b5a80c-a7c7-479b-90ee-c19d10b7b102 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d66a7ec4-6ae0-4ca4-846d-3607f2a0f297 (dataset): DatasetConfig { id: d66a7ec4-6ae0-4ca4-846d-3607f2a0f297 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8b4e99b-8ff9-4375-8d1e-95629e069979 (dataset): DatasetConfig { id: d8b4e99b-8ff9-4375-8d1e-95629e069979 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4d3c6c2-02fa-424f-ab91-eee8322ca879 (dataset): DatasetConfig { id: e4d3c6c2-02fa-424f-ab91-eee8322ca879 (dataset), name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed158eef-5a5a-48c0-a6e4-339198bd2937 (dataset): DatasetConfig { id: ed158eef-5a5a-48c0-a6e4-339198bd2937 (dataset), name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef4159a9-3ea4-4952-aef7-dc9c39fbc278 (dataset): DatasetConfig { id: ef4159a9-3ea4-4952-aef7-dc9c39fbc278 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3103896-5295-4b11-b624-83281fb6e2e5 (dataset): DatasetConfig { id: f3103896-5295-4b11-b624-83281fb6e2e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa50e82d-ec74-48a3-8aa4-7a8d56ae5232 (dataset): DatasetConfig { id: fa50e82d-ec74-48a3-8aa4-7a8d56ae5232 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4582025-01-13T09:32:37.472ZINFOSledAgent (StorageManager): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4592025-01-13T09:32:37.472ZINFOSledAgent (StorageManager): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4602025-01-13T09:32:37.472ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4612025-01-13T09:32:37.490ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-13T09:32:37.490ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-13T09:32:37.490ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/zone/oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af"), full_name: "oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/zone/oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af" } file = sled-storage/src/manager.rs:1431
4642025-01-13T09:32:37.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-13T09:32:37.552ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-13T09:32:37.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/zone/oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d"), full_name: "oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/zone/oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d" } file = sled-storage/src/manager.rs:1431
4672025-01-13T09:32:37.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-13T09:32:37.612ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-13T09:32:37.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39"), full_name: "oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39" } file = sled-storage/src/manager.rs:1431
4702025-01-13T09:32:37.674ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-13T09:32:37.674ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-13T09:32:37.674ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22bc846d-e6cf-469c-acea-15b83ef27270/crypt/zone/oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c"), full_name: "oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crypt/zone/oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c" } file = sled-storage/src/manager.rs:1431
4732025-01-13T09:32:37.732ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-13T09:32:37.732ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4752025-01-13T09:32:37.732ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/zone"), full_name: "oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/zone" } file = sled-storage/src/manager.rs:1431
4762025-01-13T09:32:37.736ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
4772025-01-13T09:32:37.762ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-01-13T09:32:37.762ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792025-01-13T09:32:37.762ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4802025-01-13T09:32:37.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-01-13T09:32:37.813ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822025-01-13T09:32:37.813ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4832025-01-13T09:32:37.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-01-13T09:32:37.862ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852025-01-13T09:32:37.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crucible" } file = sled-storage/src/manager.rs:1431
4862025-01-13T09:32:37.911ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-01-13T09:32:37.911ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882025-01-13T09:32:37.911ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/zone/oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e"), full_name: "oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/zone/oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e" } file = sled-storage/src/manager.rs:1431
4892025-01-13T09:32:37.970ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-01-13T09:32:37.970ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4912025-01-13T09:32:37.970ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22bc846d-e6cf-469c-acea-15b83ef27270/crypt/debug"), full_name: "oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crypt/debug" } file = sled-storage/src/manager.rs:1431
4922025-01-13T09:32:37.999ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-13T09:32:37.999ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942025-01-13T09:32:37.999ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4952025-01-13T09:32:38.047ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-13T09:32:38.047ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972025-01-13T09:32:38.047ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4982025-01-13T09:32:38.098ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-13T09:32:38.098ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-13T09:32:38.098ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5012025-01-13T09:32:38.148ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-13T09:32:38.148ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-13T09:32:38.148ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f"), full_name: "oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f" } file = sled-storage/src/manager.rs:1431
5042025-01-13T09:32:38.208ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-13T09:32:38.208ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-01-13T09:32:38.208ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2" } file = sled-storage/src/manager.rs:1431
5072025-01-13T09:32:38.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-13T09:32:38.268ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5092025-01-13T09:32:38.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone" } file = sled-storage/src/manager.rs:1431
5102025-01-13T09:32:38.297ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-13T09:32:38.297ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5122025-01-13T09:32:38.297ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/zone"), full_name: "oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/zone" } file = sled-storage/src/manager.rs:1431
5132025-01-13T09:32:38.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-13T09:32:38.327ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-13T09:32:38.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5162025-01-13T09:32:38.377ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-13T09:32:38.377ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5182025-01-13T09:32:38.377ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5192025-01-13T09:32:38.406ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-13T09:32:38.406ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5212025-01-13T09:32:38.406ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/debug"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/debug" } file = sled-storage/src/manager.rs:1431
5222025-01-13T09:32:38.435ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-13T09:32:38.435ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-13T09:32:38.435ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1" } file = sled-storage/src/manager.rs:1431
5252025-01-13T09:32:38.494ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-13T09:32:38.495ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-13T09:32:38.495ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone/oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a"), full_name: "oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone/oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a" } file = sled-storage/src/manager.rs:1431
5282025-01-13T09:32:38.554ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-13T09:32:38.554ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-01-13T09:32:38.554ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22bc846d-e6cf-469c-acea-15b83ef27270/crypt/zone/oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee"), full_name: "oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crypt/zone/oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee" } file = sled-storage/src/manager.rs:1431
5312025-01-13T09:32:38.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-13T09:32:38.615ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5332025-01-13T09:32:38.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/debug"), full_name: "oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/debug" } file = sled-storage/src/manager.rs:1431
5342025-01-13T09:32:38.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-13T09:32:38.645ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5362025-01-13T09:32:38.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/debug"), full_name: "oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/debug" } file = sled-storage/src/manager.rs:1431
5372025-01-13T09:32:38.674ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-13T09:32:38.674ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392025-01-13T09:32:38.674ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/zone"), full_name: "oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5402025-01-13T09:32:38.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-13T09:32:38.703ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-13T09:32:38.703ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5432025-01-13T09:32:38.738ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
5442025-01-13T09:32:38.755ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-01-13T09:32:38.755ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-01-13T09:32:38.755ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33"), full_name: "oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33" } file = sled-storage/src/manager.rs:1431
5472025-01-13T09:32:38.816ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-13T09:32:38.816ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492025-01-13T09:32:38.816ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045" } file = sled-storage/src/manager.rs:1431
5502025-01-13T09:32:38.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-13T09:32:38.875ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-01-13T09:32:38.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/zone/oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d"), full_name: "oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/zone/oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d" } file = sled-storage/src/manager.rs:1431
5532025-01-13T09:32:38.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-13T09:32:38.934ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552025-01-13T09:32:38.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5562025-01-13T09:32:38.985ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-13T09:32:38.985ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582025-01-13T09:32:38.985ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crucible" } file = sled-storage/src/manager.rs:1431
5592025-01-13T09:32:39.023ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
5602025-01-13T09:32:39.024ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5612025-01-13T09:32:39.035ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-01-13T09:32:39.035ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632025-01-13T09:32:39.035ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab" } file = sled-storage/src/manager.rs:1431
5642025-01-13T09:32:39.063ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/nexus.rs:527 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
5652025-01-13T09:32:39.098ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-13T09:32:39.098ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5672025-01-13T09:32:39.098ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/debug"), full_name: "oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5682025-01-13T09:32:39.128ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-13T09:32:39.128ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-13T09:32:39.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crucible" } file = sled-storage/src/manager.rs:1431
5712025-01-13T09:32:39.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-13T09:32:39.175ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732025-01-13T09:32:39.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb" } file = sled-storage/src/manager.rs:1431
5742025-01-13T09:32:39.237ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-01-13T09:32:39.237ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-01-13T09:32:39.237ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05" } file = sled-storage/src/manager.rs:1431
5772025-01-13T09:32:39.297ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-01-13T09:32:39.297ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792025-01-13T09:32:39.297ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crucible" } file = sled-storage/src/manager.rs:1431
5802025-01-13T09:32:39.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-01-13T09:32:39.345ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-01-13T09:32:39.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crucible" } file = sled-storage/src/manager.rs:1431
5832025-01-13T09:32:39.392ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-01-13T09:32:39.392ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5852025-01-13T09:32:39.392ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/debug"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/debug" } file = sled-storage/src/manager.rs:1431
5862025-01-13T09:32:39.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-01-13T09:32:39.423ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-01-13T09:32:39.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5892025-01-13T09:32:39.471ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-01-13T09:32:39.472ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-01-13T09:32:39.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crucible" } file = sled-storage/src/manager.rs:1431
5922025-01-13T09:32:39.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-01-13T09:32:39.519ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5942025-01-13T09:32:39.519ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/debug"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/debug" } file = sled-storage/src/manager.rs:1431
5952025-01-13T09:32:39.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-13T09:32:39.548ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-13T09:32:39.548ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crucible" } file = sled-storage/src/manager.rs:1431
5982025-01-13T09:32:39.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-13T09:32:39.595ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002025-01-13T09:32:39.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82" } file = sled-storage/src/manager.rs:1431
6012025-01-13T09:32:39.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-13T09:32:39.657ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032025-01-13T09:32:39.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crucible" } file = sled-storage/src/manager.rs:1431
6042025-01-13T09:32:39.705ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-13T09:32:39.705ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6062025-01-13T09:32:39.705ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone"), full_name: "oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone" } file = sled-storage/src/manager.rs:1431
6072025-01-13T09:32:39.735ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-13T09:32:39.735ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-01-13T09:32:39.735ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a" } file = sled-storage/src/manager.rs:1431
6102025-01-13T09:32:39.740ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
6112025-01-13T09:32:39.794ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-13T09:32:39.794ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6132025-01-13T09:32:39.794ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone" } file = sled-storage/src/manager.rs:1431
6142025-01-13T09:32:39.822ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152025-01-13T09:32:39.822ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6162025-01-13T09:32:39.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crucible" } file = sled-storage/src/manager.rs:1431
6172025-01-13T09:32:39.870ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182025-01-13T09:32:39.870ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6192025-01-13T09:32:39.870ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80" } file = sled-storage/src/manager.rs:1431
6202025-01-13T09:32:39.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-13T09:32:39.930ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-13T09:32:39.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/zone/oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270" } file = sled-storage/src/manager.rs:1431
6232025-01-13T09:32:39.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-13T09:32:39.991ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6252025-01-13T09:32:39.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone/oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26"), full_name: "oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone/oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26" } file = sled-storage/src/manager.rs:1431
6262025-01-13T09:32:40.055ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-13T09:32:40.055ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282025-01-13T09:32:40.055ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1" } file = sled-storage/src/manager.rs:1431
6292025-01-13T09:32:40.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-01-13T09:32:40.116ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312025-01-13T09:32:40.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294" } file = sled-storage/src/manager.rs:1431
6322025-01-13T09:32:40.177ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-01-13T09:32:40.177ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342025-01-13T09:32:40.177ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8" } file = sled-storage/src/manager.rs:1431
6352025-01-13T09:32:40.254ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-01-13T09:32:40.254ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-01-13T09:32:40.254ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), full_name: "oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/zone/oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594" } file = sled-storage/src/manager.rs:1431
6382025-01-13T09:32:40.314ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-01-13T09:32:40.314ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6402025-01-13T09:32:40.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone"), full_name: "oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone" } file = sled-storage/src/manager.rs:1431
6412025-01-13T09:32:40.344ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-01-13T09:32:40.344ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6432025-01-13T09:32:40.344ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd"), full_name: "oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/zone/oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd" } file = sled-storage/src/manager.rs:1431
6442025-01-13T09:32:40.404ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-01-13T09:32:40.404ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6462025-01-13T09:32:40.404ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861"), full_name: "oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/zone/oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861" } file = sled-storage/src/manager.rs:1431
6472025-01-13T09:32:40.465ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-13T09:32:40.465ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492025-01-13T09:32:40.465ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6502025-01-13T09:32:40.516ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512025-01-13T09:32:40.516ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6522025-01-13T09:32:40.516ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone/oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63"), full_name: "oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/zone/oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63" } file = sled-storage/src/manager.rs:1431
6532025-01-13T09:32:40.578ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6542025-01-13T09:32:40.578ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6552025-01-13T09:32:40.578ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/debug"), full_name: "oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/debug" } file = sled-storage/src/manager.rs:1431
6562025-01-13T09:32:40.608ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6572025-01-13T09:32:40.608ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6582025-01-13T09:32:40.608ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6592025-01-13T09:32:40.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6602025-01-13T09:32:40.658ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6612025-01-13T09:32:40.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22bc846d-e6cf-469c-acea-15b83ef27270/crypt/zone"), full_name: "oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crypt/zone" } file = sled-storage/src/manager.rs:1431
6622025-01-13T09:32:40.687ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6632025-01-13T09:32:40.687ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6642025-01-13T09:32:40.687ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/debug"), full_name: "oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/debug" } file = sled-storage/src/manager.rs:1431
6652025-01-13T09:32:40.718ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6662025-01-13T09:32:40.718ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6672025-01-13T09:32:40.719ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
6682025-01-13T09:32:40.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3247119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44338 req_id = f64b64ca-69d0-498d-a213-4651ca502908 response_code = 200 uri = /datasets
6692025-01-13T09:32:40.741ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
6702025-01-13T09:32:40.750ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 71902bad-a686-4e55-a47d-0aa068188db1 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1f43c908-b359-4270-af63-5cac8aa77fdb (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 786f0836-6abb-49b5-bb1d-fbf4e2e1f87a (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6712025-01-13T09:32:40.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50537
6722025-01-13T09:32:40.751ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6732025-01-13T09:32:40.751ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6742025-01-13T09:32:40.760ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6752025-01-13T09:32:40.760ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6762025-01-13T09:32:40.769ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6772025-01-13T09:32:40.769ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }
6782025-01-13T09:32:40.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6792025-01-13T09:32:40.778ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:188
6802025-01-13T09:32:40.778ZINFOSledAgent (ServiceManager): No ledger in /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:188
6812025-01-13T09:32:40.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6822025-01-13T09:32:40.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6832025-01-13T09:32:40.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6842025-01-13T09:32:40.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6852025-01-13T09:32:40.873ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb file = illumos-utils/src/zone.rs:325
6862025-01-13T09:32:40.877ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1 file = illumos-utils/src/zone.rs:325
6872025-01-13T09:32:40.881ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a file = illumos-utils/src/zone.rs:325
6882025-01-13T09:32:40.893ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb file = illumos-utils/src/zone.rs:363
6892025-01-13T09:32:40.897ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1 file = illumos-utils/src/zone.rs:363
6902025-01-13T09:32:40.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a file = illumos-utils/src/zone.rs:363
6912025-01-13T09:32:41.064ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/nexus.rs:527 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
6922025-01-13T09:32:41.218ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.384012464s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
6932025-01-13T09:32:41.742ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
6942025-01-13T09:32:42.535ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952025-01-13T09:32:42.535ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6962025-01-13T09:32:42.535ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
6972025-01-13T09:32:43.021ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6982025-01-13T09:32:43.021ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6992025-01-13T09:32:43.505ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7002025-01-13T09:32:43.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 46.787251ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7012025-01-13T09:32:43.515ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7022025-01-13T09:32:43.520ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7032025-01-13T09:32:43.520ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7042025-01-13T09:32:43.537ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 25.130445ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
7052025-01-13T09:32:43.566ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 132.977859ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
7062025-01-13T09:32:43.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 89.494064ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7072025-01-13T09:32:43.642ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12842864745301173243 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7082025-01-13T09:32:43.642ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15352024314294576796 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7092025-01-13T09:32:43.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 42.219848ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7102025-01-13T09:32:43.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 73.248699ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7112025-01-13T09:32:43.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 229.291211ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7122025-01-13T09:32:43.700ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7132025-01-13T09:32:43.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 104.818873ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7142025-01-13T09:32:43.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 145.996369ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7152025-01-13T09:32:44.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 224.201845ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7162025-01-13T09:32:44.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 538.945691ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7172025-01-13T09:32:44.025ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7182025-01-13T09:32:44.025ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7192025-01-13T09:32:44.027ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7202025-01-13T09:32:44.027ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7212025-01-13T09:32:44.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 261.161334ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7222025-01-13T09:32:44.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7232025-01-13T09:32:44.213ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7242025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7292025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7312025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7332025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7352025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7372025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7392025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7412025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7432025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7452025-01-13T09:32:44.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462025-01-13T09:32:44.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 451.924111ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7472025-01-13T09:32:44.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 556.668438ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7482025-01-13T09:32:44.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 446.603518ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7492025-01-13T09:32:44.569ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 929312412178090425 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7502025-01-13T09:32:44.569ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8337928307870898799 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7512025-01-13T09:32:44.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 709.472659ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7522025-01-13T09:32:44.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 855.827755ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7532025-01-13T09:32:45.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 730.283537ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7542025-01-13T09:32:45.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 839.842249ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7552025-01-13T09:32:45.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 1.032717875s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7562025-01-13T09:32:45.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 679.894063ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7572025-01-13T09:32:46.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 1.154297698s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7582025-01-13T09:32:46.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 524.546268ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7592025-01-13T09:32:46.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 538.144555ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7602025-01-13T09:32:46.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 1.111665124s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7612025-01-13T09:32:47.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 1.290170369s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7622025-01-13T09:32:47.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 871.753349ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7632025-01-13T09:32:48.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 1.180144974s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7642025-01-13T09:32:48.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 1.199017135s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7652025-01-13T09:32:48.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 1.471852614s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7662025-01-13T09:32:49.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 569.428992ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7672025-01-13T09:32:49.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 1.1272687s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7682025-01-13T09:32:49.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 889.154138ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7692025-01-13T09:32:50.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 1.018727864s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7702025-01-13T09:32:50.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 508.259345ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7712025-01-13T09:32:50.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 694.497707ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7722025-01-13T09:32:51.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 967.619489ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7732025-01-13T09:32:51.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 1.150476357s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7742025-01-13T09:32:51.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1") failed: Property not found. retry in 1.482127928s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7752025-01-13T09:32:52.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb") failed: Property not found. retry in 1.334256524s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7762025-01-13T09:32:52.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a") failed: Property not found. retry in 1.202284737s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7772025-01-13T09:32:53.552ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_1f43c908-b359-4270-af63-5cac8aa77fdb
7782025-01-13T09:32:53.552ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_71902bad-a686-4e55-a47d-0aa068188db1
7792025-01-13T09:32:53.552ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_786f0836-6abb-49b5-bb1d-fbf4e2e1f87a
7802025-01-13T09:32:53.552ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7812025-01-13T09:32:53.552ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7822025-01-13T09:32:53.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12801761 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50537 req_id = de97cca6-f5f2-4fe7-a7cb-a2cebc97beb4 response_code = 204 uri = /omicron-zones
7832025-01-13T09:32:53.554ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7842025-01-13T09:32:53.644ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12842864745301173243 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7852025-01-13T09:32:53.644ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15352024314294576796 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7862025-01-13T09:32:54.571ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 929312412178090425 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7872025-01-13T09:32:54.571ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8337928307870898799 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
7882025-01-13T09:32:54.710ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 130.572578ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7892025-01-13T09:32:54.870ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7902025-01-13T09:32:54.966ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 94.415721ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7912025-01-13T09:32:55.091ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7922025-01-13T09:32:55.150ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7932025-01-13T09:32:55.150ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7942025-01-13T09:32:55.182ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7952025-01-13T09:32:55.183ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7962025-01-13T09:32:55.183ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7972025-01-13T09:32:55.212ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 71902bad-a686-4e55-a47d-0aa068188db1 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1f43c908-b359-4270-af63-5cac8aa77fdb (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 786f0836-6abb-49b5-bb1d-fbf4e2e1f87a (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b09bbe5f-8efe-4989-ba56-19c6dd832f26 (service), filesystem_pool: Some(ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fbfb80ac-21db-4fac-9940-b1bd5b56e087, kind: Service { id: b09bbe5f-8efe-4989-ba56-19c6dd832f26 }, name: Name("ntp-b09bbe5f-8efe-4989-ba56-19c6dd832f26"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 188])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7982025-01-13T09:32:55.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41029
7992025-01-13T09:32:55.213ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8002025-01-13T09:32:55.213ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8012025-01-13T09:32:55.224ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8022025-01-13T09:32:55.224ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8032025-01-13T09:32:55.233ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8042025-01-13T09:32:55.233ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }
8052025-01-13T09:32:55.243ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8062025-01-13T09:32:55.243ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
8072025-01-13T09:32:55.243ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
8082025-01-13T09:32:55.243ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8092025-01-13T09:32:55.255ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8102025-01-13T09:32:55.286ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
8112025-01-13T09:32:55.287ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
8122025-01-13T09:32:55.287ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
8132025-01-13T09:32:55.317ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 136, 188]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8142025-01-13T09:32:55.317ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
8152025-01-13T09:32:55.317ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
8162025-01-13T09:32:55.317ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8172025-01-13T09:32:55.317ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8182025-01-13T09:32:55.318ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8192025-01-13T09:32:55.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26 file = illumos-utils/src/zone.rs:325
8202025-01-13T09:32:55.358ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26 file = illumos-utils/src/zone.rs:363
8212025-01-13T09:32:56.037ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8222025-01-13T09:32:56.037ZINFOSledAgent (ServiceManager): Booting oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8232025-01-13T09:32:56.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 49.279279ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8242025-01-13T09:32:56.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 77.473442ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8252025-01-13T09:32:56.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 118.056564ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8262025-01-13T09:32:56.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 262.239359ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8272025-01-13T09:32:56.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 491.033627ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8282025-01-13T09:32:57.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 658.392321ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8292025-01-13T09:32:57.748ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/probe_manager.rs:231 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8302025-01-13T09:32:57.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 1.470883944s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8312025-01-13T09:32:58.069ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/23b0ec58-d6f5-4744-a480-2ff78825ad63) file = sled-agent/src/nexus.rs:527 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8322025-01-13T09:32:59.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 1.172809662s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8332025-01-13T09:33:00.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26") failed: Property not found. retry in 1.231145831s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8342025-01-13T09:33:01.802ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26
8352025-01-13T09:33:01.802ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8362025-01-13T09:33:01.802ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8372025-01-13T09:33:01.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6589908 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41029 req_id = a2e4ff37-256c-463b-b9bc-5cd1247de4ff response_code = 204 uri = /omicron-zones
8382025-01-13T09:33:01.805ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8392025-01-13T09:33:01.835ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402025-01-13T09:33:01.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57775
8412025-01-13T09:33:01.845ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8422025-01-13T09:33:01.846ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9851 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57775 req_id = 89b038d9-5ce0-4ba6-819f-acb2ed16fb69 response_code = 500 uri = /timesync
8432025-01-13T09:33:01.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442025-01-13T09:33:02.017ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8452025-01-13T09:33:02.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49178
8462025-01-13T09:33:02.978ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3498047946275545907 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8472025-01-13T09:33:03.467ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15418669359249689013 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8482025-01-13T09:33:03.554ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2493168916942967698 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8492025-01-13T09:33:03.645ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12842864745301173243 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8502025-01-13T09:33:03.645ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15352024314294576796 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8512025-01-13T09:33:04.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 929312412178090425 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8522025-01-13T09:33:04.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8337928307870898799 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
8532025-01-13T09:33:06.026ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8542025-01-13T09:33:06.026ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49178 req_id = b52232b7-411d-4e6e-84f8-ec7fe9568a13 response_code = 500 uri = /timesync
8552025-01-13T09:33:06.028ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562025-01-13T09:33:06.227ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572025-01-13T09:33:06.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46630
8582025-01-13T09:33:06.236ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8592025-01-13T09:33:06.236ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9099 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46630 req_id = c5f50ccb-5535-46ed-ad67-d49c6ea4d213 response_code = 500 uri = /timesync
8602025-01-13T09:33:06.239ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612025-01-13T09:33:06.441ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622025-01-13T09:33:06.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58638
8632025-01-13T09:33:06.449ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b09bbe5f-8efe-4989-ba56-19c6dd832f26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8642025-01-13T09:33:06.449ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7891 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58638 req_id = 59943c09-9e71-4875-bf0c-b011752b97b2 response_code = 500 uri = /timesync
8652025-01-13T09:33:06.451ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662025-01-13T09:33:06.648ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672025-01-13T09:33:06.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50331
8682025-01-13T09:33:10.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4009296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50331 req_id = d19b3ad1-ee18-4960-8c79-fa5fce48b818 response_code = 200 uri = /timesync
8692025-01-13T09:33:10.657ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1736760790.3267243, correction: -0.05061122 } file = sled-agent/src/rack_setup/service.rs:743
8702025-01-13T09:33:10.657ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712025-01-13T09:33:10.867ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8722025-01-13T09:33:10.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45333
8732025-01-13T09:33:10.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7957 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45333 req_id = 7871236e-8765-45fc-861b-611b87ea41bc response_code = 200 uri = /timesync
8742025-01-13T09:33:10.878ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1736760790.3267243, correction: -0.050006084 } file = sled-agent/src/rack_setup/service.rs:743
8752025-01-13T09:33:10.878ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8762025-01-13T09:33:11.153ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772025-01-13T09:33:11.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64560
8782025-01-13T09:33:11.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19734 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64560 req_id = 31095562-305e-4386-8f30-e653719ccade response_code = 200 uri = /timesync
8792025-01-13T09:33:11.177ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1736760790.3267243, correction: -0.049227882 } file = sled-agent/src/rack_setup/service.rs:743
8802025-01-13T09:33:11.177ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8812025-01-13T09:33:11.206ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 71902bad-a686-4e55-a47d-0aa068188db1 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1f43c908-b359-4270-af63-5cac8aa77fdb (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 786f0836-6abb-49b5-bb1d-fbf4e2e1f87a (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b09bbe5f-8efe-4989-ba56-19c6dd832f26 (service), filesystem_pool: Some(ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fbfb80ac-21db-4fac-9940-b1bd5b56e087, kind: Service { id: b09bbe5f-8efe-4989-ba56-19c6dd832f26 }, name: Name("ntp-b09bbe5f-8efe-4989-ba56-19c6dd832f26"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 188])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } } } }, OmicronZoneConfig { id: a60b5f46-9031-4e68-b099-7c09af75e294 (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } } } }, OmicronZoneConfig { id: b378e5ac-6abe-4a66-a8a6-e2d930593cf1 (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } } } }, OmicronZoneConfig { id: c7a44c6a-9321-4ef3-a930-3ce43b5b7eee (service), filesystem_pool: Some(ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External } } } }, OmicronZoneConfig { id: cf05fd0a-5893-4b0f-8178-1cf35f3d0b63 (service), filesystem_pool: Some(ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8822025-01-13T09:33:11.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56435
8832025-01-13T09:33:11.206ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8842025-01-13T09:33:11.206ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8852025-01-13T09:33:11.217ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8862025-01-13T09:33:11.217ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8872025-01-13T09:33:11.226ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8882025-01-13T09:33:11.226ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }
8892025-01-13T09:33:11.236ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8902025-01-13T09:33:11.236ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8912025-01-13T09:33:11.245ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8922025-01-13T09:33:11.245ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8932025-01-13T09:33:11.254ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8942025-01-13T09:33:11.254ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Cockroach }, responder: ... }
8952025-01-13T09:33:11.263ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8962025-01-13T09:33:11.263ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8972025-01-13T09:33:11.272ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8982025-01-13T09:33:11.272ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8992025-01-13T09:33:11.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9002025-01-13T09:33:11.281ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
9012025-01-13T09:33:11.281ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
9022025-01-13T09:33:11.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9032025-01-13T09:33:11.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9042025-01-13T09:33:11.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9052025-01-13T09:33:11.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9062025-01-13T09:33:11.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9072025-01-13T09:33:11.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9082025-01-13T09:33:11.450ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1 file = illumos-utils/src/zone.rs:325
9092025-01-13T09:33:11.454ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 file = illumos-utils/src/zone.rs:325
9102025-01-13T09:33:11.458ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63 file = illumos-utils/src/zone.rs:325
9112025-01-13T09:33:11.463ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294 file = illumos-utils/src/zone.rs:325
9122025-01-13T09:33:11.466ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee file = illumos-utils/src/zone.rs:325
9132025-01-13T09:33:11.471ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1 file = illumos-utils/src/zone.rs:363
9142025-01-13T09:33:11.476ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 file = illumos-utils/src/zone.rs:363
9152025-01-13T09:33:11.480ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63 file = illumos-utils/src/zone.rs:363
9162025-01-13T09:33:11.485ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294 file = illumos-utils/src/zone.rs:363
9172025-01-13T09:33:11.489ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee file = illumos-utils/src/zone.rs:363
9182025-01-13T09:33:11.636ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 237.712628ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
9192025-01-13T09:33:13.740ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61724
9202025-01-13T09:33:13.740ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61724 req_id = e274fd6b-1084-4d64-a364-c2793f71ed50 response_code = 200 uri = /baseboard
9212025-01-13T09:33:14.346ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cf05fd0a-5893-4b0f-8178-1cf35f3d0b63'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9222025-01-13T09:33:14.346ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9232025-01-13T09:33:14.358ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='03ccaa5c-3eb6-4bef-92b4-9c9761c51df2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9242025-01-13T09:33:14.358ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a60b5f46-9031-4e68-b099-7c09af75e294'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9252025-01-13T09:33:14.358ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9262025-01-13T09:33:14.363ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9272025-01-13T09:33:14.376ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c7a44c6a-9321-4ef3-a930-3ce43b5b7eee'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9282025-01-13T09:33:14.376ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9292025-01-13T09:33:14.451ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b378e5ac-6abe-4a66-a8a6-e2d930593cf1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9302025-01-13T09:33:14.451ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9312025-01-13T09:33:14.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 72.298096ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9322025-01-13T09:33:14.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 39.348142ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9332025-01-13T09:33:14.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 29.619191ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9342025-01-13T09:33:14.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 53.573634ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9352025-01-13T09:33:14.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 93.41708ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9362025-01-13T09:33:14.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 143.803696ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9372025-01-13T09:33:14.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 51.376783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9382025-01-13T09:33:14.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 267.098814ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9392025-01-13T09:33:15.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 85.315545ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9402025-01-13T09:33:15.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 195.578926ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9412025-01-13T09:33:15.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 272.208971ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9422025-01-13T09:33:15.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 358.977241ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9432025-01-13T09:33:15.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 192.060645ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9442025-01-13T09:33:15.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 30.982296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9452025-01-13T09:33:15.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 288.356651ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9462025-01-13T09:33:15.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 134.506457ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9472025-01-13T09:33:16.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 454.76349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9482025-01-13T09:33:16.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 228.782133ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9492025-01-13T09:33:16.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 151.138679ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9502025-01-13T09:33:16.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 855.098331ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9512025-01-13T09:33:16.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 956.686349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9522025-01-13T09:33:16.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 316.763094ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9532025-01-13T09:33:16.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 936.818356ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9542025-01-13T09:33:16.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 865.873217ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9552025-01-13T09:33:16.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 845.27327ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9562025-01-13T09:33:17.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 553.949109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9572025-01-13T09:33:17.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 1.261854627s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9582025-01-13T09:33:17.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 897.095809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9592025-01-13T09:33:17.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 1.412139155s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9602025-01-13T09:33:17.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 1.449798419s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9612025-01-13T09:33:17.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 944.337496ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9622025-01-13T09:33:18.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 728.663599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9632025-01-13T09:33:18.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 592.934431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9642025-01-13T09:33:18.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 888.02156ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9652025-01-13T09:33:18.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 656.145564ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9662025-01-13T09:33:18.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 593.788042ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9672025-01-13T09:33:18.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 1.497752783s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9682025-01-13T09:33:19.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 772.234013ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9692025-01-13T09:33:19.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 792.511203ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9702025-01-13T09:33:19.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 502.966795ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9712025-01-13T09:33:19.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 541.298919ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9722025-01-13T09:33:19.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 1.001053201s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9732025-01-13T09:33:19.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 1.047823032s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9742025-01-13T09:33:20.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 1.287424387s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9752025-01-13T09:33:20.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 579.395179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9762025-01-13T09:33:20.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 848.308968ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9772025-01-13T09:33:20.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 1.240945837s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9782025-01-13T09:33:20.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 536.471196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9792025-01-13T09:33:21.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 1.202608078s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9802025-01-13T09:33:21.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 723.982411ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9812025-01-13T09:33:21.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 556.057333ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9822025-01-13T09:33:21.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 1.151693153s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9832025-01-13T09:33:21.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 936.368676ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9842025-01-13T09:33:21.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 513.301871ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9852025-01-13T09:33:22.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 1.335287596s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9862025-01-13T09:33:22.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 955.593679ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9872025-01-13T09:33:22.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 1.386625756s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9882025-01-13T09:33:22.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 909.780542ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9892025-01-13T09:33:22.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 546.820093ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9902025-01-13T09:33:23.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63") failed: Property not found. retry in 1.025710404s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9912025-01-13T09:33:23.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee") failed: Property not found. retry in 1.117529678s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
9922025-01-13T09:33:23.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2") failed: Property not found. retry in 1.416480769s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9932025-01-13T09:33:23.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294") failed: Property not found. retry in 762.988036ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9942025-01-13T09:33:23.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1") failed: Property not found. retry in 527.684242ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9952025-01-13T09:33:24.844ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_b378e5ac-6abe-4a66-a8a6-e2d930593cf1
9962025-01-13T09:33:24.844ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2
9972025-01-13T09:33:24.844ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_cf05fd0a-5893-4b0f-8178-1cf35f3d0b63
9982025-01-13T09:33:24.844ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_a60b5f46-9031-4e68-b099-7c09af75e294
9992025-01-13T09:33:24.844ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_c7a44c6a-9321-4ef3-a930-3ce43b5b7eee
10002025-01-13T09:33:24.844ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10012025-01-13T09:33:24.845ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10022025-01-13T09:33:24.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13677049 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56435 req_id = 54eb51eb-c673-473d-afcc-51c4552aaf34 response_code = 204 uri = /omicron-zones
10032025-01-13T09:33:24.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32805
10042025-01-13T09:33:24.907ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 7af7081a-303a-4738-bf57-407a8fe2578a response_code = 500 uri = /cockroachdb
10052025-01-13T09:33:24.908ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7af7081a-303a-4738-bf57-407a8fe2578a", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7af7081a-303a-4738-bf57-407a8fe2578a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 119.793003ms
10062025-01-13T09:33:25.057ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 4732d962-dd1f-4b04-acae-80106d7f8aa4 response_code = 500 uri = /cockroachdb
10072025-01-13T09:33:25.057ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4732d962-dd1f-4b04-acae-80106d7f8aa4", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4732d962-dd1f-4b04-acae-80106d7f8aa4" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 120.773405ms
10082025-01-13T09:33:25.206ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27929 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 8b6fb6b3-a281-46fb-a12c-d3484b261272 response_code = 500 uri = /cockroachdb
10092025-01-13T09:33:25.206ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8b6fb6b3-a281-46fb-a12c-d3484b261272", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8b6fb6b3-a281-46fb-a12c-d3484b261272" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 181.535989ms
10102025-01-13T09:33:25.416ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = bd24521c-d21b-4cf3-9290-db1f20183e37 response_code = 500 uri = /cockroachdb
10112025-01-13T09:33:25.417ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bd24521c-d21b-4cf3-9290-db1f20183e37", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bd24521c-d21b-4cf3-9290-db1f20183e37" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 119.861659ms
10122025-01-13T09:33:25.564ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = c1ca4d7a-d250-4672-bb81-3b131b89a0de response_code = 500 uri = /cockroachdb
10132025-01-13T09:33:25.564ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c1ca4d7a-d250-4672-bb81-3b131b89a0de", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c1ca4d7a-d250-4672-bb81-3b131b89a0de" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 203.370931ms
10142025-01-13T09:33:25.797ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = d4a96248-c612-44c1-8509-df1fd00cd2b9 response_code = 500 uri = /cockroachdb
10152025-01-13T09:33:25.797ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d4a96248-c612-44c1-8509-df1fd00cd2b9", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d4a96248-c612-44c1-8509-df1fd00cd2b9" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 212.182215ms
10162025-01-13T09:33:26.039ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 68b35e6c-03ec-43bb-9e92-efc78048d787 response_code = 500 uri = /cockroachdb
10172025-01-13T09:33:26.039ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "68b35e6c-03ec-43bb-9e92-efc78048d787", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "68b35e6c-03ec-43bb-9e92-efc78048d787" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 428.41403ms
10182025-01-13T09:33:26.496ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28116 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = adea97ec-0b57-44d4-bd86-15ce6a88b7fd response_code = 500 uri = /cockroachdb
10192025-01-13T09:33:26.496ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "adea97ec-0b57-44d4-bd86-15ce6a88b7fd", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "adea97ec-0b57-44d4-bd86-15ce6a88b7fd" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 490.992251ms
10202025-01-13T09:33:26.887ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 258.261147ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
10212025-01-13T09:33:27.015ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28145 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 6f2f03b4-a7c4-4ab8-8860-6d14d2b8a7f9 response_code = 500 uri = /cockroachdb
10222025-01-13T09:33:27.015ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6f2f03b4-a7c4-4ab8-8860-6d14d2b8a7f9", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6f2f03b4-a7c4-4ab8-8860-6d14d2b8a7f9" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 376.521313ms
10232025-01-13T09:33:27.421ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28675 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 1c5d488f-e339-4414-8b43-ed2f7c446821 response_code = 500 uri = /cockroachdb
10242025-01-13T09:33:27.421ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1c5d488f-e339-4414-8b43-ed2f7c446821", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1c5d488f-e339-4414-8b43-ed2f7c446821" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 303.978197ms
10252025-01-13T09:33:27.751ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 97e998da-ae36-4093-b965-b982ef1ebffb response_code = 500 uri = /cockroachdb
10262025-01-13T09:33:27.751ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "97e998da-ae36-4093-b965-b982ef1ebffb", "content-length": "124", "date": "Mon, 13 Jan 2025 09:33:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "97e998da-ae36-4093-b965-b982ef1ebffb" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 846.370471ms
10272025-01-13T09:33:28.626ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3769
10282025-01-13T09:33:44.759ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
10292025-01-13T09:33:49.024ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
10302025-01-13T09:33:49.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20430109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 02b8b537-b2ad-4184-ae0b-98fad93832af response_code = 204 uri = /cockroachdb
10312025-01-13T09:33:49.027ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33425
10322025-01-13T09:33:49.029ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33425 req_id = ade49f4d-d26e-4751-8561-80fb72b4fd87 response_code = 200 uri = /baseboard
10332025-01-13T09:33:49.041ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 720.129552ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
10342025-01-13T09:33:49.071ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 71902bad-a686-4e55-a47d-0aa068188db1 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1f43c908-b359-4270-af63-5cac8aa77fdb (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 786f0836-6abb-49b5-bb1d-fbf4e2e1f87a (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b09bbe5f-8efe-4989-ba56-19c6dd832f26 (service), filesystem_pool: Some(ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fbfb80ac-21db-4fac-9940-b1bd5b56e087, kind: Service { id: b09bbe5f-8efe-4989-ba56-19c6dd832f26 }, name: Name("ntp-b09bbe5f-8efe-4989-ba56-19c6dd832f26"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 188])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 03ccaa5c-3eb6-4bef-92b4-9c9761c51df2 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } } } }, OmicronZoneConfig { id: a60b5f46-9031-4e68-b099-7c09af75e294 (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } } } }, OmicronZoneConfig { id: b378e5ac-6abe-4a66-a8a6-e2d930593cf1 (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } } } }, OmicronZoneConfig { id: c7a44c6a-9321-4ef3-a930-3ce43b5b7eee (service), filesystem_pool: Some(ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External } } } }, OmicronZoneConfig { id: cf05fd0a-5893-4b0f-8178-1cf35f3d0b63 (service), filesystem_pool: Some(ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External } } } }, OmicronZoneConfig { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af (service), filesystem_pool: Some(ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 75030227-4feb-42d6-8a03-eae109062efd (service), filesystem_pool: Some(ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c3c1e4d1-6dfd-41a3-8a41-d02098f85b39 (service), filesystem_pool: Some(ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 96932656-1464-4b6f-bd14-9fea89a9fc05 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } } } }, OmicronZoneConfig { id: c24979f1-411c-47dd-b370-e455d337cd82 (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 51cdab66-c910-418b-a3d5-2c744d5149ab (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 83d1ae5b-e267-4777-9c96-3d7d36d5ba33 (service), filesystem_pool: Some(ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: dc1b31f0-02c3-4c5f-99e1-0663848855c8 (service), filesystem_pool: Some(ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6f27ea7e-5e7b-49e8-98df-8d525f67e045 (service), filesystem_pool: Some(ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External } } } }, OmicronZoneConfig { id: ea4a8e57-a344-4899-9417-d2d1472d5270 (service), filesystem_pool: Some(ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External } } } }, OmicronZoneConfig { id: 7f6aa099-f5a4-4152-b0e8-51cd807edc2c (service), filesystem_pool: Some(ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External } } } }, OmicronZoneConfig { id: a6b15ca4-0c7e-4a2f-8d72-7e15a593045a (service), filesystem_pool: Some(ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5f4707cd-c77e-49eb-b402-8eecfc54cc0d (service), filesystem_pool: Some(ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External } } } }, OmicronZoneConfig { id: d609f944-94ac-4634-9cd8-071bc4776b6d (service), filesystem_pool: Some(ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 59cd34ae-dee1-44d0-80f3-915f078ced9e (service), filesystem_pool: Some(ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External } } } }, OmicronZoneConfig { id: 1d3b0eee-78a4-4714-ac30-bfa32c78518f (service), filesystem_pool: Some(ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10352025-01-13T09:33:49.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61395
10362025-01-13T09:33:49.072ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10372025-01-13T09:33:49.072ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10382025-01-13T09:33:49.084ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10392025-01-13T09:33:49.084ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10402025-01-13T09:33:49.093ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10412025-01-13T09:33:49.093ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: InternalDns }, responder: ... }
10422025-01-13T09:33:49.104ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10432025-01-13T09:33:49.104ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10442025-01-13T09:33:49.113ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10452025-01-13T09:33:49.113ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10462025-01-13T09:33:49.121ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10472025-01-13T09:33:49.121ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10482025-01-13T09:33:49.132ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10492025-01-13T09:33:49.132ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10502025-01-13T09:33:49.143ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10512025-01-13T09:33:49.143ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10522025-01-13T09:33:49.153ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10532025-01-13T09:33:49.154ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10542025-01-13T09:33:49.164ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10552025-01-13T09:33:49.164ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10562025-01-13T09:33:49.175ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10572025-01-13T09:33:49.175ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10582025-01-13T09:33:49.187ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10592025-01-13T09:33:49.187ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, kind: Crucible }, responder: ... }
10602025-01-13T09:33:49.199ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10612025-01-13T09:33:49.199ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, kind: Crucible }, responder: ... }
10622025-01-13T09:33:49.209ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10632025-01-13T09:33:49.209ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, kind: Crucible }, responder: ... }
10642025-01-13T09:33:49.220ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10652025-01-13T09:33:49.220ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, kind: Crucible }, responder: ... }
10662025-01-13T09:33:49.230ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10672025-01-13T09:33:49.230ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10682025-01-13T09:33:49.241ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10692025-01-13T09:33:49.241ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, kind: Crucible }, responder: ... }
10702025-01-13T09:33:49.251ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-01-13T09:33:49.251ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10722025-01-13T09:33:49.261ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-01-13T09:33:49.261ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, kind: Crucible }, responder: ... }
10742025-01-13T09:33:49.272ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-01-13T09:33:49.272ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10762025-01-13T09:33:49.282ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10772025-01-13T09:33:49.282ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
10782025-01-13T09:33:49.282ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
10792025-01-13T09:33:49.283ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10802025-01-13T09:33:49.414ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10812025-01-13T09:33:49.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10822025-01-13T09:33:49.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832025-01-13T09:33:49.427ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10842025-01-13T09:33:49.442ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10852025-01-13T09:33:49.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862025-01-13T09:33:49.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10872025-01-13T09:33:49.443ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10882025-01-13T09:33:49.470ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892025-01-13T09:33:49.471ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10902025-01-13T09:33:49.619ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10912025-01-13T09:33:49.619ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10922025-01-13T09:33:49.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932025-01-13T09:33:49.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10942025-01-13T09:33:49.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-01-13T09:33:49.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10962025-01-13T09:33:49.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10972025-01-13T09:33:49.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-01-13T09:33:49.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10992025-01-13T09:33:49.672ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a file = illumos-utils/src/zone.rs:325
11002025-01-13T09:33:49.677ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e file = illumos-utils/src/zone.rs:325
11012025-01-13T09:33:49.683ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39 file = illumos-utils/src/zone.rs:325
11022025-01-13T09:33:49.687ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045 file = illumos-utils/src/zone.rs:325
11032025-01-13T09:33:49.693ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c file = illumos-utils/src/zone.rs:325
11042025-01-13T09:33:49.700ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d file = illumos-utils/src/zone.rs:325
11052025-01-13T09:33:49.875ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a file = illumos-utils/src/zone.rs:363
11062025-01-13T09:33:49.880ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e file = illumos-utils/src/zone.rs:363
11072025-01-13T09:33:49.886ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39 file = illumos-utils/src/zone.rs:363
11082025-01-13T09:33:49.891ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045 file = illumos-utils/src/zone.rs:363
11092025-01-13T09:33:49.896ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c file = illumos-utils/src/zone.rs:363
11102025-01-13T09:33:49.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d file = illumos-utils/src/zone.rs:363
11112025-01-13T09:33:49.906ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d file = illumos-utils/src/zone.rs:325
11122025-01-13T09:33:49.911ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f file = illumos-utils/src/zone.rs:325
11132025-01-13T09:33:49.916ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270 file = illumos-utils/src/zone.rs:325
11142025-01-13T09:33:49.922ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33 file = illumos-utils/src/zone.rs:325
11152025-01-13T09:33:49.927ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8 file = illumos-utils/src/zone.rs:325
11162025-01-13T09:33:49.935ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82 file = illumos-utils/src/zone.rs:325
11172025-01-13T09:33:49.942ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab file = illumos-utils/src/zone.rs:325
11182025-01-13T09:33:49.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05 file = illumos-utils/src/zone.rs:325
11192025-01-13T09:33:50.019ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11202025-01-13T09:33:50.020ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d file = illumos-utils/src/zone.rs:363
11212025-01-13T09:33:50.058ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f file = illumos-utils/src/zone.rs:363
11222025-01-13T09:33:50.063ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270 file = illumos-utils/src/zone.rs:363
11232025-01-13T09:33:50.079ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33 file = illumos-utils/src/zone.rs:363
11242025-01-13T09:33:50.107ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8 file = illumos-utils/src/zone.rs:363
11252025-01-13T09:33:50.126ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82 file = illumos-utils/src/zone.rs:363
11262025-01-13T09:33:50.149ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab file = illumos-utils/src/zone.rs:363
11272025-01-13T09:33:50.172ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05 file = illumos-utils/src/zone.rs:363
11282025-01-13T09:33:50.253ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11292025-01-13T09:33:50.311ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11302025-01-13T09:33:50.399ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11312025-01-13T09:33:50.524ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11322025-01-13T09:33:50.527ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11332025-01-13T09:33:50.527ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11342025-01-13T09:33:50.655ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 170, 112]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11352025-01-13T09:33:50.655ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
11362025-01-13T09:33:50.658ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11372025-01-13T09:33:50.658ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11382025-01-13T09:33:50.733ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 229, 105]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11392025-01-13T09:33:50.733ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
11402025-01-13T09:33:50.737ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11412025-01-13T09:33:50.737ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11422025-01-13T09:33:50.804ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 226, 27]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11432025-01-13T09:33:50.804ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
11442025-01-13T09:33:50.806ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11452025-01-13T09:33:50.806ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11462025-01-13T09:33:50.885ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 226, 233]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11472025-01-13T09:33:50.885ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
11482025-01-13T09:33:50.889ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11492025-01-13T09:33:50.889ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11502025-01-13T09:33:50.960ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 195, 251]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11512025-01-13T09:33:50.960ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
11522025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11532025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11542025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11552025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11562025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11572025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11582025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11592025-01-13T09:33:50.961ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11602025-01-13T09:33:50.977ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11612025-01-13T09:33:50.979ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11622025-01-13T09:33:51.084ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11632025-01-13T09:33:51.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11642025-01-13T09:33:51.090ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11652025-01-13T09:33:51.094ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11662025-01-13T09:33:51.094ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11672025-01-13T09:33:51.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11682025-01-13T09:33:51.098ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11692025-01-13T09:33:51.098ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11702025-01-13T09:33:51.282ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11712025-01-13T09:33:51.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11722025-01-13T09:33:51.310ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80 file = illumos-utils/src/zone.rs:325
11732025-01-13T09:33:51.321ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594 file = illumos-utils/src/zone.rs:325
11742025-01-13T09:33:51.333ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af file = illumos-utils/src/zone.rs:325
11752025-01-13T09:33:51.343ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd file = illumos-utils/src/zone.rs:325
11762025-01-13T09:33:51.396ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80 file = illumos-utils/src/zone.rs:363
11772025-01-13T09:33:51.408ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594 file = illumos-utils/src/zone.rs:363
11782025-01-13T09:33:51.418ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af file = illumos-utils/src/zone.rs:363
11792025-01-13T09:33:51.429ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd file = illumos-utils/src/zone.rs:363
11802025-01-13T09:33:51.437ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861 file = illumos-utils/src/zone.rs:325
11812025-01-13T09:33:51.474ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861 file = illumos-utils/src/zone.rs:363
11822025-01-13T09:33:53.902ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bb5e7a12-1de1-4a6d-bbdf-2fe48b462148'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11832025-01-13T09:33:53.902ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='845628a8-a4c3-4459-8210-ab4f46f0c255'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11842025-01-13T09:33:53.902ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
11852025-01-13T09:33:53.914ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
11862025-01-13T09:33:53.924ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='591699e0-f2da-448b-a991-0cbcca152616'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11872025-01-13T09:33:53.924ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='678b9d18-28b3-4b28-828d-9e366d883969'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882025-01-13T09:33:53.931ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_22bc846d-e6cf-469c-acea-15b83ef27270/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f928c68f-aec7-46b8-bc09-68044f0f3eb5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892025-01-13T09:33:53.932ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
11902025-01-13T09:33:53.935ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
11912025-01-13T09:33:53.944ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
11922025-01-13T09:33:53.956ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='87ea8229-8b35-4d96-b4d7-18c53f4e24f0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932025-01-13T09:33:53.957ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
11942025-01-13T09:33:54.008ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952025-01-13T09:33:54.009ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
11962025-01-13T09:33:54.022ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972025-01-13T09:33:54.022ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
11982025-01-13T09:33:54.036ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e937a4fd-c729-423e-b240-74a53438f33e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11992025-01-13T09:33:54.046ZINFOSledAgent (ServiceManager): Booting oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
12002025-01-13T09:33:54.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 31.515964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
12012025-01-13T09:33:54.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 61.816532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
12022025-01-13T09:33:54.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 55.233496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
12032025-01-13T09:33:54.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 39.106559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
12042025-01-13T09:33:54.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 65.51951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
12052025-01-13T09:33:54.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 47.57866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
12062025-01-13T09:33:54.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 71.095783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
12072025-01-13T09:33:54.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 48.34823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
12082025-01-13T09:33:54.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 130.1858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
12092025-01-13T09:33:55.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 134.321568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
12102025-01-13T09:33:55.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 125.411467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
12112025-01-13T09:33:55.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 35.733446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
12122025-01-13T09:33:55.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 63.629968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
12132025-01-13T09:33:55.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 75.841257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
12142025-01-13T09:33:55.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 89.045968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
12152025-01-13T09:33:55.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 123.884985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
12162025-01-13T09:33:55.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 147.181641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
12172025-01-13T09:33:55.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 215.803542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
12182025-01-13T09:33:55.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 119.261827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
12192025-01-13T09:33:56.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 202.108214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
12202025-01-13T09:33:56.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 118.927534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
12212025-01-13T09:33:56.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 238.075625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
12222025-01-13T09:33:56.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 168.539995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
12232025-01-13T09:33:56.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 104.330269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
12242025-01-13T09:33:56.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 252.91065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
12252025-01-13T09:33:57.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 168.078562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
12262025-01-13T09:33:57.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 395.609346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
12272025-01-13T09:33:57.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 455.098242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
12282025-01-13T09:33:57.137ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2d21d124-4fe9-4521-a981-56305fb4f50e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12292025-01-13T09:33:57.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 211.599327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
12302025-01-13T09:33:57.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 254.07011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
12312025-01-13T09:33:57.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 286.126404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
12322025-01-13T09:33:57.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 575.506205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
12332025-01-13T09:33:57.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 245.626867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
12342025-01-13T09:33:57.219ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5c10f9e5-4d0a-4a1c-b517-c3d047aabf5c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352025-01-13T09:33:57.220ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362025-01-13T09:33:57.220ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
12372025-01-13T09:33:57.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 292.478586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
12382025-01-13T09:33:57.238ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
12392025-01-13T09:33:57.245ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
12402025-01-13T09:33:57.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 572.837127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
12412025-01-13T09:33:57.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.086130564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
12422025-01-13T09:33:57.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 469.65864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
12432025-01-13T09:33:57.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 36.951426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
12442025-01-13T09:33:57.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 25.689063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
12452025-01-13T09:33:57.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 839.89779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
12462025-01-13T09:33:57.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 1.099837467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
12472025-01-13T09:33:57.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 64.769234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
12482025-01-13T09:33:57.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 133.672346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
12492025-01-13T09:33:57.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 51.632774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
12502025-01-13T09:33:57.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 1.022288001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
12512025-01-13T09:33:57.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 417.959458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
12522025-01-13T09:33:57.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 147.120445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
12532025-01-13T09:33:57.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 177.509004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
12542025-01-13T09:33:57.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 542.757244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
12552025-01-13T09:33:57.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 116.815995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
12562025-01-13T09:33:57.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 280.036429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
12572025-01-13T09:33:57.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 421.666605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
12582025-01-13T09:33:57.833ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='c3c1e4d1-6dfd-41a3-8a41-d02098f85b39'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12592025-01-13T09:33:57.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 715.991336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
12602025-01-13T09:33:57.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 997.148256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
12612025-01-13T09:33:57.879ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
12622025-01-13T09:33:57.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 205.096385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
12632025-01-13T09:33:57.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 880.699105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
12642025-01-13T09:33:58.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.014317204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
12652025-01-13T09:33:58.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 322.742862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
12662025-01-13T09:33:58.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 484.844422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
12672025-01-13T09:33:58.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.183172087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
12682025-01-13T09:33:58.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.028557463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
12692025-01-13T09:33:58.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 31.236108ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
12702025-01-13T09:33:58.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 838.68202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
12712025-01-13T09:33:58.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 89.390918ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
12722025-01-13T09:33:58.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.469463668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
12732025-01-13T09:33:58.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.03415086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
12742025-01-13T09:33:58.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 696.672332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
12752025-01-13T09:33:58.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 188.893649ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
12762025-01-13T09:33:58.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 766.830615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
12772025-01-13T09:33:58.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.335049014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
12782025-01-13T09:33:58.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.373803698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
12792025-01-13T09:33:58.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 507.378314ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
12802025-01-13T09:33:58.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 1.171790673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
12812025-01-13T09:33:58.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.094654342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
12822025-01-13T09:33:58.944ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832025-01-13T09:33:58.944ZINFOSledAgent (ServiceManager): Booting oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
12842025-01-13T09:33:59.015ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12852025-01-13T09:33:59.018ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862025-01-13T09:33:59.018ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
12872025-01-13T09:33:59.029ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
12882025-01-13T09:33:59.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.221892272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
12892025-01-13T09:33:59.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 54.89191ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
12902025-01-13T09:33:59.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 910.101931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
12912025-01-13T09:33:59.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 32.483011ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
12922025-01-13T09:33:59.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 122.097999ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
12932025-01-13T09:33:59.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 43.8777ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
12942025-01-13T09:33:59.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 667.409283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
12952025-01-13T09:33:59.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 146.529211ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
12962025-01-13T09:33:59.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 685.081316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
12972025-01-13T09:33:59.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 110.707236ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
12982025-01-13T09:33:59.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 531.301902ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
12992025-01-13T09:33:59.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.180289517s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
13002025-01-13T09:33:59.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 282.560292ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
13012025-01-13T09:33:59.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 262.680046ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
13022025-01-13T09:33:59.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 828.992081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
13032025-01-13T09:33:59.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 209.057649ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
13042025-01-13T09:33:59.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 793.936982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
13052025-01-13T09:33:59.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 318.71694ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
13062025-01-13T09:33:59.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 437.37068ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
13072025-01-13T09:33:59.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 467.064603ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
13082025-01-13T09:33:59.904ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092025-01-13T09:33:59.904ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13102025-01-13T09:33:59.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 747.81647ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
13112025-01-13T09:34:00.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 521.753608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
13122025-01-13T09:34:00.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 595.744405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
13132025-01-13T09:34:00.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.214564584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
13142025-01-13T09:34:00.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.004230315s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
13152025-01-13T09:34:00.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.124938656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
13162025-01-13T09:34:00.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 809.242979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
13172025-01-13T09:34:00.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 1.111967801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
13182025-01-13T09:34:00.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 535.423701ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
13192025-01-13T09:34:00.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.110177107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
13202025-01-13T09:34:00.167ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212025-01-13T09:34:00.168ZINFOSledAgent (ServiceManager): Booting oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13222025-01-13T09:34:00.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 32.051604ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13232025-01-13T09:34:00.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 111.245886ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13242025-01-13T09:34:00.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 606.971513ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
13252025-01-13T09:34:00.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.217299905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
13262025-01-13T09:34:00.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 678.574573ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
13272025-01-13T09:34:00.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 150.688138ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13282025-01-13T09:34:00.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 769.411254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
13292025-01-13T09:34:00.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 35.260248ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13302025-01-13T09:34:00.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.051890955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
13312025-01-13T09:34:00.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 132.34115ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13322025-01-13T09:34:00.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 402.251847ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13332025-01-13T09:34:00.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.351208307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
13342025-01-13T09:34:00.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 222.112534ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13352025-01-13T09:34:00.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 810.813471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
13362025-01-13T09:34:00.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 988.851908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
13372025-01-13T09:34:00.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 582.446684ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
13382025-01-13T09:34:00.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.386890434s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
13392025-01-13T09:34:00.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 574.990842ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13402025-01-13T09:34:00.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 774.145013ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
13412025-01-13T09:34:00.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 672.70227ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13422025-01-13T09:34:00.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 761.609422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
13432025-01-13T09:34:01.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.485965626s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
13442025-01-13T09:34:01.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.447780331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
13452025-01-13T09:34:01.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 952.559088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
13462025-01-13T09:34:01.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 542.516577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
13472025-01-13T09:34:01.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 898.961198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
13482025-01-13T09:34:01.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 719.748583ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
13492025-01-13T09:34:01.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 973.449159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
13502025-01-13T09:34:01.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 526.341706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
13512025-01-13T09:34:01.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.197621823s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13522025-01-13T09:34:01.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 1.172035063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
13532025-01-13T09:34:01.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 639.403832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
13542025-01-13T09:34:01.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 539.474822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
13552025-01-13T09:34:01.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.076104966s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13562025-01-13T09:34:01.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 927.241438ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
13572025-01-13T09:34:01.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.372015288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
13582025-01-13T09:34:01.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.290981659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
13592025-01-13T09:34:01.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 798.820085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
13602025-01-13T09:34:01.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 951.768619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
13612025-01-13T09:34:01.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 806.598233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
13622025-01-13T09:34:02.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.46082843s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
13632025-01-13T09:34:02.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.22093602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
13642025-01-13T09:34:02.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 858.892824ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
13652025-01-13T09:34:02.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 1.259802956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
13662025-01-13T09:34:02.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 1.013242607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
13672025-01-13T09:34:02.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 977.967589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
13682025-01-13T09:34:02.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 946.165661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
13692025-01-13T09:34:02.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 970.117017ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
13702025-01-13T09:34:02.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.131927818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
13712025-01-13T09:34:02.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.097471829s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
13722025-01-13T09:34:02.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.145378607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
13732025-01-13T09:34:02.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 671.031267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
13742025-01-13T09:34:02.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 982.695331ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13752025-01-13T09:34:02.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.364711875s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
13762025-01-13T09:34:02.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.27305358s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
13772025-01-13T09:34:02.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 684.774385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
13782025-01-13T09:34:02.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 643.69482ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
13792025-01-13T09:34:03.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 571.413127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
13802025-01-13T09:34:03.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.458465484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
13812025-01-13T09:34:03.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.219880445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
13822025-01-13T09:34:03.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 773.459734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
13832025-01-13T09:34:03.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.121924434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
13842025-01-13T09:34:03.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 926.398466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
13852025-01-13T09:34:03.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 527.69047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
13862025-01-13T09:34:03.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 799.018415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
13872025-01-13T09:34:03.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 990.07459ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
13882025-01-13T09:34:03.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.098814329s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
13892025-01-13T09:34:03.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 532.073842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
13902025-01-13T09:34:03.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 621.249248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
13912025-01-13T09:34:03.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.148235492s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
13922025-01-13T09:34:03.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.299627768s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
13932025-01-13T09:34:03.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 821.334943ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
13942025-01-13T09:34:03.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 901.019969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
13952025-01-13T09:34:03.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.202587468s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
13962025-01-13T09:34:03.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 1.4391783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
13972025-01-13T09:34:03.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 769.575676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
13982025-01-13T09:34:04.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 880.393607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
13992025-01-13T09:34:04.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.341636163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
14002025-01-13T09:34:04.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.010555228s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
14012025-01-13T09:34:04.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 1.165884183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
14022025-01-13T09:34:04.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 679.956197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
14032025-01-13T09:34:04.245ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14042025-01-13T09:34:04.245ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14052025-01-13T09:34:04.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 840.281251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
14062025-01-13T09:34:04.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.15226937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
14072025-01-13T09:34:04.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 67.390994ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14082025-01-13T09:34:04.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.474755574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
14092025-01-13T09:34:04.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 113.064447ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14102025-01-13T09:34:04.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 658.389955ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
14112025-01-13T09:34:04.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 616.05221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
14122025-01-13T09:34:04.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.378099159s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
14132025-01-13T09:34:04.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.477858637s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
14142025-01-13T09:34:04.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 129.971913ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14152025-01-13T09:34:04.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.295881403s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
14162025-01-13T09:34:04.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 210.855471ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14172025-01-13T09:34:04.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 723.81985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
14182025-01-13T09:34:04.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.03381246s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
14192025-01-13T09:34:05.082ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.303711495s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
14202025-01-13T09:34:05.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 953.88113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
14212025-01-13T09:34:05.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 610.133369ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
14222025-01-13T09:34:05.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.380265411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
14232025-01-13T09:34:05.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.08283146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
14242025-01-13T09:34:05.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 518.896858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
14252025-01-13T09:34:05.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 804.458652ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14262025-01-13T09:34:05.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 601.226127ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
14272025-01-13T09:34:05.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 966.07673ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
14282025-01-13T09:34:05.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 972.016612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
14292025-01-13T09:34:05.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 855.660079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
14302025-01-13T09:34:05.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 810.561401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
14312025-01-13T09:34:05.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 635.666514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
14322025-01-13T09:34:05.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 869.448467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
14332025-01-13T09:34:05.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.346315261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
14342025-01-13T09:34:05.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 617.077194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
14352025-01-13T09:34:05.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 507.548467ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
14362025-01-13T09:34:05.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.404631163s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
14372025-01-13T09:34:05.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.323197055s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
14382025-01-13T09:34:05.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 873.645133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
14392025-01-13T09:34:05.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.235898744s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
14402025-01-13T09:34:05.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 553.19412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
14412025-01-13T09:34:05.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 680.80129ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14422025-01-13T09:34:06.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 505.983652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
14432025-01-13T09:34:06.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.009964661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
14442025-01-13T09:34:06.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.164638321s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
14452025-01-13T09:34:06.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.155598811s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
14462025-01-13T09:34:06.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.233415782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
14472025-01-13T09:34:06.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 936.265662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
14482025-01-13T09:34:06.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.099050952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
14492025-01-13T09:34:06.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 702.267989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
14502025-01-13T09:34:06.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 856.829311ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
14512025-01-13T09:34:06.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.257007189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
14522025-01-13T09:34:06.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 611.235922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
14532025-01-13T09:34:06.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.447659412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
14542025-01-13T09:34:06.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.267320089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
14552025-01-13T09:34:06.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 519.418167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
14562025-01-13T09:34:06.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.310825412s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14572025-01-13T09:34:06.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.133725323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
14582025-01-13T09:34:06.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.05035874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
14592025-01-13T09:34:06.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 788.809326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
14602025-01-13T09:34:06.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 570.944229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
14612025-01-13T09:34:07.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.419488009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
14622025-01-13T09:34:07.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 1.453665808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
14632025-01-13T09:34:07.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 663.797414ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
14642025-01-13T09:34:07.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 703.439082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
14652025-01-13T09:34:07.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 976.772723ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
14662025-01-13T09:34:07.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.3821304s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
14672025-01-13T09:34:07.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 588.516958ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
14682025-01-13T09:34:07.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.214189289s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
14692025-01-13T09:34:07.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.477976667s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
14702025-01-13T09:34:07.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.010170096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
14712025-01-13T09:34:07.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.221784205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
14722025-01-13T09:34:07.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 679.749284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
14732025-01-13T09:34:07.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 1.400332139s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
14742025-01-13T09:34:07.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.00405723s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
14752025-01-13T09:34:07.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.376560342s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
14762025-01-13T09:34:07.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 666.113495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
14772025-01-13T09:34:07.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 905.276019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
14782025-01-13T09:34:07.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 1.21014954s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
14792025-01-13T09:34:07.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 655.830624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
14802025-01-13T09:34:07.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.429766571s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
14812025-01-13T09:34:07.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 881.18318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
14822025-01-13T09:34:08.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.490084686s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
14832025-01-13T09:34:08.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.041460692s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
14842025-01-13T09:34:08.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.24311167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
14852025-01-13T09:34:08.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 893.810661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
14862025-01-13T09:34:08.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 615.089458ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
14872025-01-13T09:34:08.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.405674034s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
14882025-01-13T09:34:08.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.29847249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
14892025-01-13T09:34:08.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.289396286s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
14902025-01-13T09:34:08.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 1.097346456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
14912025-01-13T09:34:08.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.240081013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
14922025-01-13T09:34:08.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 572.72945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
14932025-01-13T09:34:08.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 801.978033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
14942025-01-13T09:34:08.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 996.685634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
14952025-01-13T09:34:08.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.285484836s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
14962025-01-13T09:34:08.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 774.266087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
14972025-01-13T09:34:08.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 1.427603543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
14982025-01-13T09:34:09.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 642.301128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
14992025-01-13T09:34:09.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.131718913s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
15002025-01-13T09:34:09.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.070032404s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
15012025-01-13T09:34:09.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.307087851s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
15022025-01-13T09:34:09.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 606.259423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
15032025-01-13T09:34:09.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.360596201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
15042025-01-13T09:34:09.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 608.794002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
15052025-01-13T09:34:09.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 896.759216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
15062025-01-13T09:34:09.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.452670637s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
15072025-01-13T09:34:09.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.395588382s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
15082025-01-13T09:34:09.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 667.73184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
15092025-01-13T09:34:09.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 780.316023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
15102025-01-13T09:34:09.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 687.097469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
15112025-01-13T09:34:09.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 601.127001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
15122025-01-13T09:34:09.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 594.840861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
15132025-01-13T09:34:09.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 561.305954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
15142025-01-13T09:34:09.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.061027413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
15152025-01-13T09:34:09.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 759.571426ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
15162025-01-13T09:34:09.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 736.21307ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
15172025-01-13T09:34:10.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.001736877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
15182025-01-13T09:34:10.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 666.336769ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
15192025-01-13T09:34:10.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.004428216s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
15202025-01-13T09:34:10.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 997.315301ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
15212025-01-13T09:34:10.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.471249302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
15222025-01-13T09:34:10.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 910.617803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
15232025-01-13T09:34:10.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 849.555774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
15242025-01-13T09:34:10.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.45349516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
15252025-01-13T09:34:10.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 611.557152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
15262025-01-13T09:34:10.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.026032241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
15272025-01-13T09:34:10.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 735.883366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
15282025-01-13T09:34:10.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 893.741333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
15292025-01-13T09:34:10.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 953.318422ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
15302025-01-13T09:34:10.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.164361744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
15312025-01-13T09:34:10.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.348016331s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
15322025-01-13T09:34:10.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 719.926897ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
15332025-01-13T09:34:10.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.035129459s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
15342025-01-13T09:34:10.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.11985579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
15352025-01-13T09:34:10.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.077119433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
15362025-01-13T09:34:10.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.328071504s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
15372025-01-13T09:34:11.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 599.082425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
15382025-01-13T09:34:11.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 1.010787212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
15392025-01-13T09:34:11.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 738.391323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
15402025-01-13T09:34:11.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 903.575493ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
15412025-01-13T09:34:11.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 898.413607ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
15422025-01-13T09:34:11.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.33430961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
15432025-01-13T09:34:11.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.386204036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
15442025-01-13T09:34:11.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 830.132283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
15452025-01-13T09:34:11.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.087110524s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
15462025-01-13T09:34:11.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.125030678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
15472025-01-13T09:34:11.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.180808202s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
15482025-01-13T09:34:11.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 707.488273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
15492025-01-13T09:34:11.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.060187979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
15502025-01-13T09:34:11.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 626.625183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
15512025-01-13T09:34:11.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.110674777s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
15522025-01-13T09:34:11.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 631.142817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
15532025-01-13T09:34:11.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 627.870525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
15542025-01-13T09:34:12.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.122051855s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
15552025-01-13T09:34:12.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.131505383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
15562025-01-13T09:34:12.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 557.647578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
15572025-01-13T09:34:12.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 521.881091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
15582025-01-13T09:34:12.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.415679714s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
15592025-01-13T09:34:12.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.493149589s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
15602025-01-13T09:34:12.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 1.310641619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
15612025-01-13T09:34:12.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.098480374s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
15622025-01-13T09:34:12.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.491433702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
15632025-01-13T09:34:12.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.311405894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
15642025-01-13T09:34:12.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.467474726s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
15652025-01-13T09:34:12.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 519.261596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
15662025-01-13T09:34:12.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 706.026058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
15672025-01-13T09:34:12.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.098009079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
15682025-01-13T09:34:12.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 851.204732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
15692025-01-13T09:34:12.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 885.748237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
15702025-01-13T09:34:12.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 819.328077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
15712025-01-13T09:34:12.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.399465958s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
15722025-01-13T09:34:12.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.48912535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
15732025-01-13T09:34:12.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 808.553731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
15742025-01-13T09:34:12.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 583.457841ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
15752025-01-13T09:34:13.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 879.23616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
15762025-01-13T09:34:13.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.249319878s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
15772025-01-13T09:34:13.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 510.606234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
15782025-01-13T09:34:13.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 1.204866123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
15792025-01-13T09:34:13.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 552.815088ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
15802025-01-13T09:34:13.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 507.270711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
15812025-01-13T09:34:13.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 566.079553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
15822025-01-13T09:34:13.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 582.916645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
15832025-01-13T09:34:13.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 598.17053ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
15842025-01-13T09:34:13.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 903.508648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
15852025-01-13T09:34:13.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.458483089s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
15862025-01-13T09:34:13.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 851.698751ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
15872025-01-13T09:34:13.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.210431681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
15882025-01-13T09:34:13.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 534.054185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
15892025-01-13T09:34:13.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e") failed: Property not found. retry in 1.20031297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
15902025-01-13T09:34:13.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 939.921219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
15912025-01-13T09:34:13.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 846.875753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
15922025-01-13T09:34:13.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.445677495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
15932025-01-13T09:34:13.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.136573646s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
15942025-01-13T09:34:14.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.435012042s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
15952025-01-13T09:34:14.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 900.949851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
15962025-01-13T09:34:14.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 1.038899357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
15972025-01-13T09:34:14.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.367177348s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
15982025-01-13T09:34:14.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.425842615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
15992025-01-13T09:34:14.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 769.446138ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16002025-01-13T09:34:14.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.150703674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
16012025-01-13T09:34:14.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.205793772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
16022025-01-13T09:34:14.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.347592908s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
16032025-01-13T09:34:14.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 949.422428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
16042025-01-13T09:34:14.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 1.358387425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
16052025-01-13T09:34:14.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.395215415s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16062025-01-13T09:34:14.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 969.227531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
16072025-01-13T09:34:14.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 714.351845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
16082025-01-13T09:34:14.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 1.281022309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
16092025-01-13T09:34:14.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 736.319943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
16102025-01-13T09:34:14.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.03410472s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16112025-01-13T09:34:15.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.223503804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
16122025-01-13T09:34:15.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 542.410874ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
16132025-01-13T09:34:15.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 903.579553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
16142025-01-13T09:34:15.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 628.175335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
16152025-01-13T09:34:15.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 900.135248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
16162025-01-13T09:34:15.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 617.978435ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
16172025-01-13T09:34:15.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d") failed: Property not found. retry in 510.946769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
16182025-01-13T09:34:15.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.351798612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
16192025-01-13T09:34:15.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.385113309s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
16202025-01-13T09:34:15.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 1.228357695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
16212025-01-13T09:34:15.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 571.812237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
16222025-01-13T09:34:15.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.073260105s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
16232025-01-13T09:34:15.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 755.978212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
16242025-01-13T09:34:15.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 672.064107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
16252025-01-13T09:34:15.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.371995386s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
16262025-01-13T09:34:15.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a") failed: Property not found. retry in 1.183782532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
16272025-01-13T09:34:15.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 545.566928ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16282025-01-13T09:34:16.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 888.118321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
16292025-01-13T09:34:16.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 527.685512ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16302025-01-13T09:34:16.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 958.715842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
16312025-01-13T09:34:16.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.172504451s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
16322025-01-13T09:34:16.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.029713136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
16332025-01-13T09:34:16.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c") failed: Property not found. retry in 677.789206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
16342025-01-13T09:34:16.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 624.19375ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
16352025-01-13T09:34:16.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 552.979243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
16362025-01-13T09:34:16.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 776.57052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
16372025-01-13T09:34:16.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.354048583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
16382025-01-13T09:34:16.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 777.345352ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16392025-01-13T09:34:16.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 632.308905ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16402025-01-13T09:34:16.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82") failed: Property not found. retry in 802.438903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
16412025-01-13T09:34:16.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.330721875s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
16422025-01-13T09:34:16.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.449597729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
16432025-01-13T09:34:16.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.238494332s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
16442025-01-13T09:34:16.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 1.289355479s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
16452025-01-13T09:34:16.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.118415319s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
16462025-01-13T09:34:17.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.095719321s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
16472025-01-13T09:34:17.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.298632309s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16482025-01-13T09:34:17.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.274700083s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
16492025-01-13T09:34:17.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d") failed: Property not found. retry in 857.865334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
16502025-01-13T09:34:17.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.361140917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
16512025-01-13T09:34:17.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.089127374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
16522025-01-13T09:34:17.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 871.114433ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
16532025-01-13T09:34:17.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 826.210468ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16542025-01-13T09:34:17.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270") failed: Property not found. retry in 1.082531372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
16552025-01-13T09:34:18.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 589.000311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
16562025-01-13T09:34:18.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.330238323s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
16572025-01-13T09:34:18.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.062025436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
16582025-01-13T09:34:18.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.332407822s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16592025-01-13T09:34:18.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 695.781559ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
16602025-01-13T09:34:18.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 1.497314315s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
16612025-01-13T09:34:18.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 914.743879ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
16622025-01-13T09:34:18.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 1.187267589s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
16632025-01-13T09:34:18.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 652.977003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
16642025-01-13T09:34:18.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 1.470152398s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
16652025-01-13T09:34:18.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 714.7273ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16662025-01-13T09:34:18.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 1.102720787s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
16672025-01-13T09:34:18.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 762.073108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
16682025-01-13T09:34:19.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 977.893568ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
16692025-01-13T09:34:19.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.22537046s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
16702025-01-13T09:34:19.100ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46921
16712025-01-13T09:34:19.124ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46921 req_id = 64fc09b6-2082-402a-a2bd-4bb1100f6858 response_code = 200 uri = /baseboard
16722025-01-13T09:34:19.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05") failed: Property not found. retry in 1.483395347s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
16732025-01-13T09:34:19.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 1.276737389s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16742025-01-13T09:34:19.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045") failed: Property not found. retry in 1.227295751s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
16752025-01-13T09:34:19.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 603.065634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
16762025-01-13T09:34:19.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594") failed: Property not found. retry in 1.238594787s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
16772025-01-13T09:34:19.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80") failed: Property not found. retry in 611.896088ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
16782025-01-13T09:34:19.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 640.232149ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16792025-01-13T09:34:19.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8") failed: Property not found. retry in 888.554888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
16802025-01-13T09:34:19.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f") failed: Property not found. retry in 967.845912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
16812025-01-13T09:34:19.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861") failed: Property not found. retry in 860.606272ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
16822025-01-13T09:34:20.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd") failed: Property not found. retry in 554.768192ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
16832025-01-13T09:34:20.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33") failed: Property not found. retry in 1.278755542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
16842025-01-13T09:34:20.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab") failed: Property not found. retry in 1.206636958s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
16852025-01-13T09:34:20.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af") failed: Property not found. retry in 1.105358213s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16862025-01-13T09:34:20.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39") failed: Property not found. retry in 525.870323ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16872025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_a6b15ca4-0c7e-4a2f-8d72-7e15a593045a
16882025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_59cd34ae-dee1-44d0-80f3-915f078ced9e
16892025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_ea5546c0-b69d-4baf-9b69-c722e52b8f80
16902025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_9c3f4527-02c9-47ef-aeb2-b0bfd626d594
16912025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_c3c1e4d1-6dfd-41a3-8a41-d02098f85b39
16922025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6f27ea7e-5e7b-49e8-98df-8d525f67e045
16932025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_39dbc0c2-8038-4a1e-b725-22e9ee3526af
16942025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_75030227-4feb-42d6-8a03-eae109062efd
16952025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_7f6aa099-f5a4-4152-b0e8-51cd807edc2c
16962025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_d609f944-94ac-4634-9cd8-071bc4776b6d
16972025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_5f4707cd-c77e-49eb-b402-8eecfc54cc0d
16982025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_ada928be-2ae2-46f2-a73d-9a9db5f21861
16992025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_1d3b0eee-78a4-4714-ac30-bfa32c78518f
17002025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_ea4a8e57-a344-4899-9417-d2d1472d5270
17012025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_83d1ae5b-e267-4777-9c96-3d7d36d5ba33
17022025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_dc1b31f0-02c3-4c5f-99e1-0663848855c8
17032025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_c24979f1-411c-47dd-b370-e455d337cd82
17042025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_51cdab66-c910-418b-a3d5-2c744d5149ab
17052025-01-13T09:34:21.516ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_96932656-1464-4b6f-bd14-9fea89a9fc05
17062025-01-13T09:34:21.517ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17072025-01-13T09:34:21.526ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17082025-01-13T09:34:21.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32478516 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61395 req_id = e03da238-60d8-47c4-9d05-e21bbd01c760 response_code = 204 uri = /omicron-zones
17092025-01-13T09:34:21.588ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17102025-01-13T09:34:22.032ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17112025-01-13T09:34:22.033ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
17122025-01-13T09:34:22.072ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
17132025-01-13T09:34:22.537ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.32857381s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
17142025-01-13T09:34:28.409ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17152025-01-13T09:34:28.410ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.463485181s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
17162025-01-13T09:34:28.509ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17172025-01-13T09:34:28.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17182025-01-13T09:34:28.744ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17192025-01-13T09:34:28.900ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17202025-01-13T09:34:29.016ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17212025-01-13T09:34:29.200ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17222025-01-13T09:34:29.483ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17232025-01-13T09:34:29.942ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17242025-01-13T09:34:30.227ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17252025-01-13T09:34:30.528ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17262025-01-13T09:34:31.448ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17272025-01-13T09:34:32.211ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1870dbb3-0b63-4064-8b75-d13052a6b844/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17282025-01-13T09:34:35.144ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1fba8288-8e96-4aae-a908-aa923621dbe1", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1870dbb3-0b63-4064-8b75-d13052a6b844\"", request_id: "1fba8288-8e96-4aae-a908-aa923621dbe1" } file = sled-agent/src/rack_setup/service.rs:1079
17292025-01-13T09:34:36.195ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "45b112d6-7f89-49a5-a96a-8447a0798c0b", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1870dbb3-0b63-4064-8b75-d13052a6b844\"", request_id: "45b112d6-7f89-49a5-a96a-8447a0798c0b" } file = sled-agent/src/rack_setup/service.rs:1079
17302025-01-13T09:34:38.060ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "587431ee-62c7-4c92-bb5e-26f6ec8aecc1", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1870dbb3-0b63-4064-8b75-d13052a6b844\"", request_id: "587431ee-62c7-4c92-bb5e-26f6ec8aecc1" } file = sled-agent/src/rack_setup/service.rs:1079
17312025-01-13T09:34:41.189ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "560db417-fa59-4d2f-862a-6c7b0b98f873", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "560db417-fa59-4d2f-862a-6c7b0b98f873" } file = sled-agent/src/rack_setup/service.rs:1079
17322025-01-13T09:34:43.012ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5725dad8-994a-4c87-940c-07e691672d59", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "5725dad8-994a-4c87-940c-07e691672d59" } file = sled-agent/src/rack_setup/service.rs:1079
17332025-01-13T09:34:45.802ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8810171b-7ea6-45e5-a102-4e4a26b66c0b", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "8810171b-7ea6-45e5-a102-4e4a26b66c0b" } file = sled-agent/src/rack_setup/service.rs:1079
17342025-01-13T09:34:49.007ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "91a56b39-de9a-4500-959f-b0d258036f82", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "91a56b39-de9a-4500-959f-b0d258036f82" } file = sled-agent/src/rack_setup/service.rs:1079
17352025-01-13T09:34:49.167ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40563
17362025-01-13T09:34:49.168ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40563 req_id = 0797603e-fddf-4131-86dc-8a430e9da433 response_code = 200 uri = /baseboard
17372025-01-13T09:34:51.687ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "16c5b0bf-aa22-45e7-b658-7d8980cef6f0", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "16c5b0bf-aa22-45e7-b658-7d8980cef6f0" } file = sled-agent/src/rack_setup/service.rs:1079
17382025-01-13T09:34:55.498ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "389708eb-dfb3-45b5-9ec5-2254da0618f5", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "389708eb-dfb3-45b5-9ec5-2254da0618f5" } file = sled-agent/src/rack_setup/service.rs:1079
17392025-01-13T09:34:59.502ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "73af7489-8595-456f-822c-11f140b4070d", "content-length": "173", "date": "Mon, 13 Jan 2025 09:34:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "73af7489-8595-456f-822c-11f140b4070d" } file = sled-agent/src/rack_setup/service.rs:1079
17402025-01-13T09:35:03.642ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c04bcfb7-70b5-428a-a9b9-3ec1d4fe6be7", "content-length": "173", "date": "Mon, 13 Jan 2025 09:35:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "c04bcfb7-70b5-428a-a9b9-3ec1d4fe6be7" } file = sled-agent/src/rack_setup/service.rs:1079
17412025-01-13T09:35:13.776ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1d60f509-9a6d-40d9-a2f7-23550a2c3427", "content-length": "173", "date": "Mon, 13 Jan 2025 09:35:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"23b0ec58-d6f5-4744-a480-2ff78825ad63\"", request_id: "1d60f509-9a6d-40d9-a2f7-23550a2c3427" } file = sled-agent/src/rack_setup/service.rs:1079
17422025-01-13T09:35:15.246ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
17432025-01-13T09:35:15.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37139
17442025-01-13T09:35:15.341ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17452025-01-13T09:35:15.341ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17462025-01-13T09:35:15.341ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
17472025-01-13T09:35:15.343ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
17482025-01-13T09:35:15.357ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17492025-01-13T09:35:15.357ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605
17502025-01-13T09:35:15.384ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17512025-01-13T09:35:15.384ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98
17522025-01-13T09:35:15.406ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17532025-01-13T09:35:15.406ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c
17542025-01-13T09:35:15.427ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17552025-01-13T09:35:15.427ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22bc846d-e6cf-469c-acea-15b83ef27270
17562025-01-13T09:35:15.446ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17572025-01-13T09:35:15.446ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2
17582025-01-13T09:35:15.465ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17592025-01-13T09:35:15.465ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c
17602025-01-13T09:35:15.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17612025-01-13T09:35:15.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2
17622025-01-13T09:35:15.503ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17632025-01-13T09:35:15.503ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd
17642025-01-13T09:35:15.526ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17652025-01-13T09:35:15.526ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4
17662025-01-13T09:35:15.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37139 req_id = 720c33ff-34fe-4256-8ca7-a107f98a92a4 response_code = 200 uri = /inventory
17672025-01-13T09:35:19.022ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:51883 remote_addr = [fd00:1122:3344:101::d]:38427 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
17682025-01-13T09:35:19.054ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31553 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 5345febb-dc3d-4bba-9e73-c4d7dd16af95 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
17692025-01-13T09:35:19.202ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41381
17702025-01-13T09:35:19.202ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41381 req_id = 5bd7d05d-e37a-481e-8bae-7667cd19fa0f response_code = 200 uri = /baseboard
17712025-01-13T09:35:19.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64684
17722025-01-13T09:35:19.822ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17732025-01-13T09:35:19.822ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17742025-01-13T09:35:19.822ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17752025-01-13T09:35:19.822ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17762025-01-13T09:35:19.822ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17772025-01-13T09:35:19.822ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17782025-01-13T09:35:19.822ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17792025-01-13T09:35:19.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64684 req_id = 82274d1d-c0de-4f53-833b-31b1ec8d12ff response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17802025-01-13T09:35:19.823ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
17812025-01-13T09:35:19.827ZINFOSledAgent (RSS): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17822025-01-13T09:35:19.828ZINFOSledAgent (RSS): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17832025-01-13T09:35:20.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40832
17842025-01-13T09:35:20.179ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17852025-01-13T09:35:20.179ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17862025-01-13T09:35:20.179ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
17872025-01-13T09:35:20.179ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
17882025-01-13T09:35:20.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17892025-01-13T09:35:20.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605
17902025-01-13T09:35:20.219ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17912025-01-13T09:35:20.219ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98
17922025-01-13T09:35:20.246ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17932025-01-13T09:35:20.246ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c
17942025-01-13T09:35:20.268ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17952025-01-13T09:35:20.268ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22bc846d-e6cf-469c-acea-15b83ef27270
17962025-01-13T09:35:20.290ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17972025-01-13T09:35:20.290ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2
17982025-01-13T09:35:20.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17992025-01-13T09:35:20.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c
18002025-01-13T09:35:20.331ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18012025-01-13T09:35:20.331ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2
18022025-01-13T09:35:20.351ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18032025-01-13T09:35:20.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd
18042025-01-13T09:35:20.371ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18052025-01-13T09:35:20.371ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4
18062025-01-13T09:35:20.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203864 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40832 req_id = 07de58df-fb32-45d6-ab3f-c6909d588fdc response_code = 200 uri = /inventory
18072025-01-13T09:35:21.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63410
18082025-01-13T09:35:21.336ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18092025-01-13T09:35:21.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18102025-01-13T09:35:21.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18112025-01-13T09:35:21.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18122025-01-13T09:35:21.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18132025-01-13T09:35:21.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18142025-01-13T09:35:21.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18152025-01-13T09:35:21.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63410 req_id = a3be06ec-4c31-4afb-9124-2ab52d307dc9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18162025-01-13T09:35:21.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45758
18172025-01-13T09:35:21.360ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18182025-01-13T09:35:21.360ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18192025-01-13T09:35:21.360ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18202025-01-13T09:35:21.360ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18212025-01-13T09:35:21.360ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18222025-01-13T09:35:21.360ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18232025-01-13T09:35:21.360ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18242025-01-13T09:35:21.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45758 req_id = 4a67df34-0c01-4e39-b558-fc4620c5b747 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18252025-01-13T09:35:21.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43254
18262025-01-13T09:35:21.504ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18272025-01-13T09:35:21.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18282025-01-13T09:35:21.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18292025-01-13T09:35:21.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18302025-01-13T09:35:21.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18312025-01-13T09:35:21.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18322025-01-13T09:35:21.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18332025-01-13T09:35:21.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43254 req_id = 4b2266b4-69cb-425d-9bfa-8bcc8b8d790b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18342025-01-13T09:35:25.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52548
18352025-01-13T09:35:25.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52548 req_id = be00db2e-11e6-4d50-a4fe-afc46dff44ee response_code = 200 uri = /vpc-routes
18362025-01-13T09:35:25.880ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
18372025-01-13T09:35:25.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52548 req_id = 6f3fa080-d3ce-4236-b4e3-0a5b4803bd61 response_code = 204 uri = /eip-gateways
18382025-01-13T09:35:25.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52548 req_id = 6b53b97c-197f-466e-83f2-ad349cd82b1e response_code = 204 uri = /vpc-routes
18392025-01-13T09:35:38.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56406
18402025-01-13T09:35:38.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56406 req_id = cc55ffe5-feea-401a-8d1a-74f56ea9d8f1 response_code = 200 uri = /vpc-routes
18412025-01-13T09:35:38.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54886
18422025-01-13T09:35:38.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54886 req_id = cd2a0de4-15d4-4e7d-9815-1ef055ca04df response_code = 200 uri = /vpc-routes
18432025-01-13T09:35:38.757ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
18442025-01-13T09:35:38.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56406 req_id = d3602b6d-d3d3-4802-a7b1-328dec5fb236 response_code = 204 uri = /eip-gateways
18452025-01-13T09:35:38.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56406 req_id = c91c4c41-5c3f-42bc-ab8b-34d90c205966 response_code = 204 uri = /vpc-routes
18462025-01-13T09:35:38.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
18472025-01-13T09:35:38.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54886 req_id = 7b68ac5e-a096-4c7d-8462-0e859918e3f7 response_code = 204 uri = /eip-gateways
18482025-01-13T09:35:38.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54886 req_id = 46143d7c-b158-44c7-949a-76cd448e72b8 response_code = 204 uri = /vpc-routes
18492025-01-13T09:35:38.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59929
18502025-01-13T09:35:38.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59929 req_id = 518b96e1-b437-4e43-a93f-dd37521f5219 response_code = 200 uri = /v2p
18512025-01-13T09:35:39.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59017
18522025-01-13T09:35:39.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59017 req_id = 2aaf2d92-2bd9-4430-8bb9-ad260ff73125 response_code = 200 uri = /v2p
18532025-01-13T09:35:39.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59861
18542025-01-13T09:35:39.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18552025-01-13T09:35:39.212ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18562025-01-13T09:35:39.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59861 req_id = 810df9af-90aa-4f4a-a4b0-119dc3e27b65 response_code = 204 uri = /switch-ports
18572025-01-13T09:35:39.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65270
18582025-01-13T09:35:39.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61255
18592025-01-13T09:35:39.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65270 req_id = 23b26bfd-c323-43f7-b292-e8bc76c3950b response_code = 200 uri = /vpc-routes
18602025-01-13T09:35:39.283ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18612025-01-13T09:35:39.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59861 req_id = 819e97aa-fbb3-47bb-b7cc-b2010254d083 response_code = 200 uri = /network-bootstore-config
18622025-01-13T09:35:39.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60196
18632025-01-13T09:35:39.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60196 req_id = 8bbf1cdb-513f-4720-a273-40f1b610ba18 response_code = 200 uri = /v2p
18642025-01-13T09:35:39.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18652025-01-13T09:35:39.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
18662025-01-13T09:35:39.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65270 req_id = fc379e2f-2833-4a47-97cd-384ff7187b1e response_code = 204 uri = /eip-gateways
18672025-01-13T09:35:39.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65270 req_id = a9dee2d5-55e9-4805-9a12-d27c02ef58ba response_code = 204 uri = /vpc-routes
18682025-01-13T09:35:39.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58067
18692025-01-13T09:35:39.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61255 req_id = bd5b20d0-c095-4731-aab8-4e46fe71e3ad response_code = 204 uri = /switch-ports
18702025-01-13T09:35:39.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18712025-01-13T09:35:39.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 664 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61255 req_id = d80a0b12-dd58-4d22-b8ae-0aad30b60dd8 response_code = 200 uri = /network-bootstore-config
18722025-01-13T09:35:39.417ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18732025-01-13T09:35:39.417ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18742025-01-13T09:35:39.419ZINFOSledAgent (bootstore): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18752025-01-13T09:35:39.421ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18762025-01-13T09:35:39.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3883 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59861 req_id = 46e78bba-0488-4ad2-a1e9-5dab1283f73a response_code = 204 uri = /network-bootstore-config
18772025-01-13T09:35:39.421ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18782025-01-13T09:35:39.421ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18792025-01-13T09:35:39.421ZINFOSledAgent (bootstore): Writing ledger to /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18802025-01-13T09:35:39.425ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18812025-01-13T09:35:39.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4570 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61255 req_id = 825dbe8a-feb3-4df1-a8d7-19f8d9773cda response_code = 204 uri = /network-bootstore-config
18822025-01-13T09:35:39.435ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18832025-01-13T09:35:39.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58067 req_id = 60f1b973-15d5-4272-ba36-62231aac83b4 response_code = 204 uri = /switch-ports
18842025-01-13T09:35:39.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58067 req_id = c5be97c9-6cad-4199-bb73-c584ea315f96 response_code = 200 uri = /network-bootstore-config
18852025-01-13T09:35:49.029ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7030 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = ce4a2331-5673-4115-b907-42f3ebc1cf5f response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
18862025-01-13T09:35:49.235ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43485
18872025-01-13T09:35:49.235ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43485 req_id = cc80cc02-cfa0-4207-ae9d-3ace38d185cd response_code = 200 uri = /baseboard
18882025-01-13T09:36:08.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60418
18892025-01-13T09:36:08.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60418 req_id = 295301a1-54e9-4515-b2d6-9b2740d90482 response_code = 200 uri = /vpc-routes
18902025-01-13T09:36:08.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
18912025-01-13T09:36:08.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60418 req_id = d9e58df9-f446-48cb-a0c7-3de98034918f response_code = 204 uri = /eip-gateways
18922025-01-13T09:36:08.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60418 req_id = c159d346-f4f4-4919-a4bd-0c5c42a148ed response_code = 204 uri = /vpc-routes
18932025-01-13T09:36:08.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34558
18942025-01-13T09:36:08.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34558 req_id = 211fdca1-739b-4f2b-b181-0e6dd5bdab79 response_code = 200 uri = /v2p
18952025-01-13T09:36:08.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55768
18962025-01-13T09:36:08.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55768 req_id = 1f6cfe50-36fd-4570-b5b4-814d140b685a response_code = 200 uri = /vpc-routes
18972025-01-13T09:36:08.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64423
18982025-01-13T09:36:08.750ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18992025-01-13T09:36:08.789ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19002025-01-13T09:36:08.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110989 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64423 req_id = 40e57008-de36-4a1c-9e89-787243525dd4 response_code = 204 uri = /switch-ports
19012025-01-13T09:36:08.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46030
19022025-01-13T09:36:08.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64423 req_id = f4a3e7d1-bbba-4772-b2aa-3fde8dd7517b response_code = 200 uri = /network-bootstore-config
19032025-01-13T09:36:08.862ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19042025-01-13T09:36:08.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46030 req_id = cccd2378-90e2-4fd7-89a9-c6359a4c1f92 response_code = 200 uri = /v2p
19052025-01-13T09:36:08.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55768 req_id = 7fafd22a-a6a1-4711-857a-678d1c7877d0 response_code = 204 uri = /eip-gateways
19062025-01-13T09:36:08.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55768 req_id = 549cee7a-e737-4bf9-8325-8f2eefacd95b response_code = 204 uri = /vpc-routes
19072025-01-13T09:36:08.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40053
19082025-01-13T09:36:08.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19092025-01-13T09:36:09.027ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19102025-01-13T09:36:09.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40053 req_id = 4c718a64-8d60-426a-9df5-c9d00c40e11e response_code = 204 uri = /switch-ports
19112025-01-13T09:36:09.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51599
19122025-01-13T09:36:09.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62070
19132025-01-13T09:36:09.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51599 req_id = 37351ce2-a3c1-4770-8c8d-215980d5a627 response_code = 200 uri = /vpc-routes
19142025-01-13T09:36:09.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62070 req_id = b045ad67-663f-4615-9dd3-a5642e76d682 response_code = 200 uri = /v2p
19152025-01-13T09:36:09.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40053 req_id = b9657fdd-5f54-4dcf-86e4-b70a2439ac47 response_code = 200 uri = /network-bootstore-config
19162025-01-13T09:36:09.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19172025-01-13T09:36:09.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51599 req_id = 4925cb3c-636c-4f50-8a8f-670d65c7661e response_code = 204 uri = /eip-gateways
19182025-01-13T09:36:09.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43663
19192025-01-13T09:36:09.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19202025-01-13T09:36:09.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19212025-01-13T09:36:09.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92252 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43663 req_id = b9bf21b0-3c83-4819-9eca-1687d6d1e4f4 response_code = 204 uri = /switch-ports
19222025-01-13T09:36:09.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51599 req_id = 3878f88b-a177-4146-a3a3-559bc99c5ede response_code = 204 uri = /vpc-routes
19232025-01-13T09:36:09.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43663 req_id = c20338fa-1539-469d-a5a4-fdbce636c065 response_code = 200 uri = /network-bootstore-config
19242025-01-13T09:36:19.030ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7787 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 44b33416-6f77-4d23-9daf-7437b1dc0cab response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
19252025-01-13T09:36:19.266ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54787
19262025-01-13T09:36:19.267ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54787 req_id = 0c150c17-d11c-4174-a88f-fe8efad2c4da response_code = 200 uri = /baseboard
19272025-01-13T09:36:38.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40644
19282025-01-13T09:36:38.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40644 req_id = f7f98fcf-8f67-44b1-b21f-442be71b56d3 response_code = 200 uri = /vpc-routes
19292025-01-13T09:36:38.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19302025-01-13T09:36:38.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40644 req_id = 589cbf98-586e-4bbb-b73c-230a090a1213 response_code = 204 uri = /eip-gateways
19312025-01-13T09:36:38.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61916
19322025-01-13T09:36:38.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61916 req_id = d7d1aba6-9f28-4a6f-9334-04f6a543974f response_code = 200 uri = /v2p
19332025-01-13T09:36:38.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40644 req_id = 906859e1-3586-4c5c-8549-c8fbaea95d76 response_code = 204 uri = /vpc-routes
19342025-01-13T09:36:38.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58844
19352025-01-13T09:36:38.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58844 req_id = 0cfef77f-eead-46d0-b3a4-db266047d49f response_code = 200 uri = /vpc-routes
19362025-01-13T09:36:38.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19372025-01-13T09:36:38.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58844 req_id = 7ac41991-41b6-4905-a579-551eaf34fb37 response_code = 204 uri = /eip-gateways
19382025-01-13T09:36:38.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58844 req_id = 5ee2b522-4985-4955-953e-e504b3d0fce4 response_code = 204 uri = /vpc-routes
19392025-01-13T09:36:38.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37845
19402025-01-13T09:36:38.945ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19412025-01-13T09:36:38.991ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19422025-01-13T09:36:39.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37845 req_id = 46ebff7b-0c2c-47ac-9a36-bd22b32ec935 response_code = 204 uri = /switch-ports
19432025-01-13T09:36:39.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43007
19442025-01-13T09:36:39.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43007 req_id = 2ba3ee88-c2a1-452f-9520-56ad4def4cc3 response_code = 200 uri = /v2p
19452025-01-13T09:36:39.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37845 req_id = 852d6de4-7707-4b89-be56-372101598ea3 response_code = 200 uri = /network-bootstore-config
19462025-01-13T09:36:39.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45880
19472025-01-13T09:36:39.088ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19482025-01-13T09:36:39.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19492025-01-13T09:36:39.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45880 req_id = fa19789e-6a6e-4163-92fb-e15c0c84403d response_code = 204 uri = /switch-ports
19502025-01-13T09:36:39.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45880 req_id = 8d42ea9a-316f-4e2f-a9fa-33ff9d89a727 response_code = 200 uri = /network-bootstore-config
19512025-01-13T09:36:39.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63640
19522025-01-13T09:36:39.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63640 req_id = 38208329-a3e5-4303-9b0b-f6a225ee6fb4 response_code = 200 uri = /vpc-routes
19532025-01-13T09:36:39.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63348
19542025-01-13T09:36:39.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63348 req_id = 7523fc1e-2f6a-4325-8e40-261f1997ae6a response_code = 200 uri = /v2p
19552025-01-13T09:36:39.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19562025-01-13T09:36:39.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63640 req_id = 35e30360-1b01-46cc-bda7-f4ed2e670496 response_code = 204 uri = /eip-gateways
19572025-01-13T09:36:39.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63640 req_id = f3835baa-1050-4bb0-bf02-e771e45301bb response_code = 204 uri = /vpc-routes
19582025-01-13T09:36:39.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33463
19592025-01-13T09:36:39.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19602025-01-13T09:36:39.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19612025-01-13T09:36:39.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97274 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33463 req_id = 5cf95f73-3d61-44e6-96c7-1a01987f1a59 response_code = 204 uri = /switch-ports
19622025-01-13T09:36:39.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33463 req_id = 6484e025-4cfc-4e43-9e2e-e9ee82c14b19 response_code = 200 uri = /network-bootstore-config
19632025-01-13T09:36:49.029ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8485 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = a61be354-73a7-4ccb-bbe4-5d08b8af5021 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
19642025-01-13T09:36:49.298ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56982
19652025-01-13T09:36:49.299ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56982 req_id = 036fe5b0-1060-4ee3-989c-7929981a0123 response_code = 200 uri = /baseboard
19662025-01-13T09:37:08.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37798
19672025-01-13T09:37:08.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37798 req_id = 1da17743-24dd-4779-8724-ffc49a675e9a response_code = 200 uri = /vpc-routes
19682025-01-13T09:37:08.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19692025-01-13T09:37:08.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37798 req_id = 37a823d0-0c41-4000-b913-f01c17022ae5 response_code = 204 uri = /eip-gateways
19702025-01-13T09:37:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37798 req_id = aa18e124-4b28-42d1-90c0-94b9e8a179c1 response_code = 204 uri = /vpc-routes
19712025-01-13T09:37:08.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35195
19722025-01-13T09:37:08.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35195 req_id = 539bf861-a65a-4823-9a56-a0d5a8adfc12 response_code = 200 uri = /v2p
19732025-01-13T09:37:08.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38014
19742025-01-13T09:37:08.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19752025-01-13T09:37:08.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19762025-01-13T09:37:08.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89126 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38014 req_id = ebe315c6-b2f6-4f35-acad-84411a0cc88c response_code = 204 uri = /switch-ports
19772025-01-13T09:37:08.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38014 req_id = 274a8456-08ce-49fb-90c5-bd971957598d response_code = 200 uri = /network-bootstore-config
19782025-01-13T09:37:08.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43203
19792025-01-13T09:37:08.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43203 req_id = fcd83dbd-cb79-4f5e-8d09-24dd70794f8f response_code = 200 uri = /vpc-routes
19802025-01-13T09:37:08.905ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19812025-01-13T09:37:08.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43203 req_id = 0e4e4e93-5a34-4b6f-825d-dfada38a5e68 response_code = 204 uri = /eip-gateways
19822025-01-13T09:37:08.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43203 req_id = f3aefa47-1565-4dd1-a9e0-c50a26923458 response_code = 204 uri = /vpc-routes
19832025-01-13T09:37:08.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60766
19842025-01-13T09:37:08.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19852025-01-13T09:37:08.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19862025-01-13T09:37:09.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60766 req_id = 9cd0522c-3a4d-4bfb-b93c-f49cf08a851d response_code = 204 uri = /switch-ports
19872025-01-13T09:37:09.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33152
19882025-01-13T09:37:09.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40564
19892025-01-13T09:37:09.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40564 req_id = ff052a11-f19a-49c4-90e1-f0547ee67f9d response_code = 200 uri = /vpc-routes
19902025-01-13T09:37:09.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33152 req_id = dc330ff8-057a-44f0-b759-16e931308867 response_code = 200 uri = /v2p
19912025-01-13T09:37:09.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60766 req_id = 4ad2bf5c-d6e4-47fb-9492-0bf79b242a87 response_code = 200 uri = /network-bootstore-config
19922025-01-13T09:37:09.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
19932025-01-13T09:37:09.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40564 req_id = dafa7469-53bc-4347-9e4d-2e25fe1ff228 response_code = 204 uri = /eip-gateways
19942025-01-13T09:37:09.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40564 req_id = ec09f860-576a-4eed-b6c3-e47afc811ec0 response_code = 204 uri = /vpc-routes
19952025-01-13T09:37:09.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58574
19962025-01-13T09:37:09.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58574 req_id = 473075a7-ecb1-47ee-a4b8-03b06a49be1b response_code = 200 uri = /v2p
19972025-01-13T09:37:09.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40325
19982025-01-13T09:37:09.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19992025-01-13T09:37:09.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20002025-01-13T09:37:09.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40325 req_id = f793773d-0ea6-4068-958d-811bb1c6cb45 response_code = 204 uri = /switch-ports
20012025-01-13T09:37:09.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40325 req_id = 8d313e17-0e91-49b4-a82a-269fc7a996f0 response_code = 200 uri = /network-bootstore-config
20022025-01-13T09:37:19.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7058 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 0a747f58-fc3d-4ba2-adc1-265e12a38225 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
20032025-01-13T09:37:19.331ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62692
20042025-01-13T09:37:19.331ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62692 req_id = 65ba903e-2898-47d1-9498-e6d96da85ec6 response_code = 200 uri = /baseboard
20052025-01-13T09:37:37.384ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20062025-01-13T09:37:38.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62415
20072025-01-13T09:37:38.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62415 req_id = add1cd46-9227-47fc-9fee-ad0c00b87310 response_code = 200 uri = /vpc-routes
20082025-01-13T09:37:38.741ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20092025-01-13T09:37:38.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62415 req_id = f7e02309-e08d-441a-a309-7199a678bffb response_code = 204 uri = /eip-gateways
20102025-01-13T09:37:38.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36901
20112025-01-13T09:37:38.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36901 req_id = a4536a84-6bf5-40af-91e3-472578c315ef response_code = 200 uri = /v2p
20122025-01-13T09:37:38.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61788
20132025-01-13T09:37:38.903ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20142025-01-13T09:37:38.957ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20152025-01-13T09:37:39.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61788 req_id = e31f310d-483a-474e-a5f4-f4a0c69f1fab response_code = 204 uri = /switch-ports
20162025-01-13T09:37:39.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54298
20172025-01-13T09:37:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61788 req_id = cabd955e-6ef6-4fbd-802f-1bd81b40a3f1 response_code = 200 uri = /network-bootstore-config
20182025-01-13T09:37:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54298 req_id = 98005083-5ea4-42d0-8250-dc15663d4d79 response_code = 200 uri = /v2p
20192025-01-13T09:37:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62415 req_id = 6b854eef-0ad6-4082-a153-a32267a8659d response_code = 204 uri = /vpc-routes
20202025-01-13T09:37:39.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39863
20212025-01-13T09:37:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39863 req_id = e04a4c4b-e9d1-48a4-96cf-51f5a5efe66d response_code = 200 uri = /vpc-routes
20222025-01-13T09:37:39.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20232025-01-13T09:37:39.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39863 req_id = 50b37541-5809-432a-95d6-cac798e285bb response_code = 204 uri = /eip-gateways
20242025-01-13T09:37:39.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39723
20252025-01-13T09:37:39.096ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20262025-01-13T09:37:39.151ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20272025-01-13T09:37:39.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39723 req_id = ea1d92d8-2ce1-454f-a169-012cb27b6a00 response_code = 204 uri = /switch-ports
20282025-01-13T09:37:39.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64665
20292025-01-13T09:37:39.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64665 req_id = 0a6a8a5b-59f1-473e-914f-b5335662e820 response_code = 200 uri = /vpc-routes
20302025-01-13T09:37:39.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39723 req_id = a5176ce9-288e-45b3-89b1-53ab570b1f75 response_code = 200 uri = /network-bootstore-config
20312025-01-13T09:37:39.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5704 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39863 req_id = 315ca25b-5ec5-4fb7-b67c-d605d85f1752 response_code = 204 uri = /vpc-routes
20322025-01-13T09:37:39.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20332025-01-13T09:37:39.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64665 req_id = 3f56e993-f868-4f38-a3b3-e32ecc354ffd response_code = 204 uri = /eip-gateways
20342025-01-13T09:37:39.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64665 req_id = e6ec90db-e451-4c95-bd6e-629908b9e7e7 response_code = 204 uri = /vpc-routes
20352025-01-13T09:37:39.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36823
20362025-01-13T09:37:39.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36823 req_id = f3540f7a-61c0-43c1-b45c-2a3beb413a76 response_code = 200 uri = /v2p
20372025-01-13T09:37:39.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43545
20382025-01-13T09:37:39.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20392025-01-13T09:37:39.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20402025-01-13T09:37:39.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43545 req_id = edaf2baa-1d0a-4c39-905c-74a44a81d0b4 response_code = 204 uri = /switch-ports
20412025-01-13T09:37:39.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43545 req_id = cb8acc64-1d26-4c06-8893-18ec943fc639 response_code = 200 uri = /network-bootstore-config
20422025-01-13T09:37:49.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8112 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 97e6eb66-aa95-4686-be94-b21e6a5f8159 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
20432025-01-13T09:37:49.363ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41370
20442025-01-13T09:37:49.363ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41370 req_id = dc636b50-9046-4062-812a-4f17c2a70003 response_code = 200 uri = /baseboard
20452025-01-13T09:38:08.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56631
20462025-01-13T09:38:08.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56631 req_id = 3a13d4f1-ed90-4079-a2c3-7bcee60adbac response_code = 200 uri = /vpc-routes
20472025-01-13T09:38:08.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20482025-01-13T09:38:08.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56631 req_id = 5840b03b-0d81-4a3c-aa94-890770f67a82 response_code = 204 uri = /eip-gateways
20492025-01-13T09:38:08.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56631 req_id = 48c9fa32-ed84-4867-abb7-361ec41cf3b8 response_code = 204 uri = /vpc-routes
20502025-01-13T09:38:08.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46116
20512025-01-13T09:38:08.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46116 req_id = b2a3bf1f-3427-403d-9012-43fec9a741bb response_code = 200 uri = /v2p
20522025-01-13T09:38:08.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38441
20532025-01-13T09:38:08.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20542025-01-13T09:38:08.721ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20552025-01-13T09:38:08.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38441 req_id = 6799f47b-2fc3-4bf4-a83f-398dddc2d2e1 response_code = 204 uri = /switch-ports
20562025-01-13T09:38:08.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38441 req_id = 85af102b-3682-4e1f-861f-a8c6ebc58d5a response_code = 200 uri = /network-bootstore-config
20572025-01-13T09:38:08.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62682
20582025-01-13T09:38:08.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62682 req_id = 5749a69c-a385-49fd-8a2c-59dfa6d589e8 response_code = 200 uri = /v2p
20592025-01-13T09:38:08.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52886
20602025-01-13T09:38:08.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52886 req_id = 56caee3a-473e-489e-a091-2e656349683e response_code = 200 uri = /vpc-routes
20612025-01-13T09:38:08.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20622025-01-13T09:38:08.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52886 req_id = 8691a345-c70e-4c97-9534-ca7a6d497df4 response_code = 204 uri = /eip-gateways
20632025-01-13T09:38:08.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44450
20642025-01-13T09:38:08.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20652025-01-13T09:38:08.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20662025-01-13T09:38:08.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44450 req_id = 8144fcfa-c512-4ad0-ab52-30d2dd148306 response_code = 204 uri = /switch-ports
20672025-01-13T09:38:08.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44450 req_id = e1c5198c-d5ff-44b9-be48-c077c85ec5db response_code = 200 uri = /network-bootstore-config
20682025-01-13T09:38:08.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52886 req_id = a943ed42-240a-432c-bb31-c4304f7ae1cd response_code = 204 uri = /vpc-routes
20692025-01-13T09:38:09.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54175
20702025-01-13T09:38:09.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54175 req_id = 5b9da047-bc2f-4082-aaf6-5820ad90f0b4 response_code = 200 uri = /vpc-routes
20712025-01-13T09:38:09.032ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20722025-01-13T09:38:09.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54175 req_id = dc9ee975-58da-4776-a01c-bb1807aaa492 response_code = 204 uri = /eip-gateways
20732025-01-13T09:38:09.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54175 req_id = 43d7188b-09e2-4e40-8ea7-d16bf8220c76 response_code = 204 uri = /vpc-routes
20742025-01-13T09:38:09.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56311
20752025-01-13T09:38:09.099ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20762025-01-13T09:38:09.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20772025-01-13T09:38:09.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98124 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56311 req_id = 793b9058-f495-4552-b427-bb00c7f2da36 response_code = 204 uri = /switch-ports
20782025-01-13T09:38:09.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54392
20792025-01-13T09:38:09.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54392 req_id = bfe8b959-d4ef-45f4-99b8-40db053e5246 response_code = 200 uri = /v2p
20802025-01-13T09:38:09.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56311 req_id = ea3bd0f1-158b-4549-b6f9-91f8285a04ec response_code = 200 uri = /network-bootstore-config
20812025-01-13T09:38:19.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7579 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = e49966cc-3acc-470c-a33e-a360ac0973fd response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
20822025-01-13T09:38:19.396ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35316
20832025-01-13T09:38:19.396ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35316 req_id = d422a6b8-ff5f-4b73-af70-166888763027 response_code = 200 uri = /baseboard
20842025-01-13T09:38:38.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53916
20852025-01-13T09:38:38.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53916 req_id = 038cd8f0-835a-4766-b655-33b786b80abb response_code = 200 uri = /vpc-routes
20862025-01-13T09:38:38.683ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20872025-01-13T09:38:38.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53916 req_id = 112a0e9f-399b-45d8-8836-d8a68992b80c response_code = 204 uri = /eip-gateways
20882025-01-13T09:38:38.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53916 req_id = a070fd18-8db4-4a1f-8137-9bda0a78b243 response_code = 204 uri = /vpc-routes
20892025-01-13T09:38:38.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64358
20902025-01-13T09:38:38.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64358 req_id = b1399288-bc0e-4da7-a8fc-1037c9bd17f3 response_code = 200 uri = /vpc-routes
20912025-01-13T09:38:38.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
20922025-01-13T09:38:38.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64358 req_id = dddb0e1c-1c19-445c-8b02-a42e98fde359 response_code = 204 uri = /eip-gateways
20932025-01-13T09:38:38.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64358 req_id = 72b51903-3f6f-48bc-b1ad-b4dd26d50ece response_code = 204 uri = /vpc-routes
20942025-01-13T09:38:38.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53017
20952025-01-13T09:38:38.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53017 req_id = 986daad4-f08e-4029-884a-1afee6261424 response_code = 200 uri = /v2p
20962025-01-13T09:38:39.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49757
20972025-01-13T09:38:39.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20982025-01-13T09:38:39.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20992025-01-13T09:38:39.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49757 req_id = 55173b86-7028-4826-8dbc-6b57b0bf6e3f response_code = 204 uri = /switch-ports
21002025-01-13T09:38:39.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32920
21012025-01-13T09:38:39.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45249
21022025-01-13T09:38:39.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49757 req_id = fe84244c-4963-4a69-b006-0b5a1ae60932 response_code = 200 uri = /network-bootstore-config
21032025-01-13T09:38:39.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32920 req_id = 1250bf73-fc31-4fc7-8315-2d7908c6fb13 response_code = 200 uri = /vpc-routes
21042025-01-13T09:38:39.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45249 req_id = f5df2447-7b4b-4d88-bbb3-70cb8f9538ca response_code = 200 uri = /v2p
21052025-01-13T09:38:39.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
21062025-01-13T09:38:39.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32920 req_id = 53f191e1-0481-4d01-a5bd-1fe7eca1ba57 response_code = 204 uri = /eip-gateways
21072025-01-13T09:38:39.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32920 req_id = e5b81f8d-9b56-4dcc-8524-0d12cce5492d response_code = 204 uri = /vpc-routes
21082025-01-13T09:38:39.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34922
21092025-01-13T09:38:39.202ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21102025-01-13T09:38:39.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21112025-01-13T09:38:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104634 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34922 req_id = 7a8b3f9e-43be-48f7-b7a7-f2615cafd054 response_code = 204 uri = /switch-ports
21122025-01-13T09:38:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34922 req_id = d954a341-09a3-4edc-9ec6-baf11674088c response_code = 200 uri = /network-bootstore-config
21132025-01-13T09:38:39.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60012
21142025-01-13T09:38:39.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60012 req_id = 6b9bc2e9-d1fb-476f-8132-de9549d0da1e response_code = 200 uri = /v2p
21152025-01-13T09:38:39.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42183
21162025-01-13T09:38:39.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21172025-01-13T09:38:39.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21182025-01-13T09:38:39.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42183 req_id = 801ed756-8a51-4e07-8212-49c075db8c5d response_code = 204 uri = /switch-ports
21192025-01-13T09:38:39.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42183 req_id = 6cdcc3de-8f91-4e2b-8869-07aaa58e2d2c response_code = 200 uri = /network-bootstore-config
21202025-01-13T09:38:49.027ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7795 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = e43bdd48-fba8-48d2-a393-6bc957084be6 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
21212025-01-13T09:38:49.429ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42524
21222025-01-13T09:38:49.429ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42524 req_id = f1e7961c-87fe-455b-a010-16416b482d35 response_code = 200 uri = /baseboard
21232025-01-13T09:39:08.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61612
21242025-01-13T09:39:08.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61612 req_id = ad3099d9-b64b-4b57-abf9-c862482aac51 response_code = 200 uri = /vpc-routes
21252025-01-13T09:39:08.657ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
21262025-01-13T09:39:08.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61612 req_id = ce7f2aaa-bab9-4837-a02e-e97f43a6ac37 response_code = 204 uri = /eip-gateways
21272025-01-13T09:39:08.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61612 req_id = ca8734bb-0ba2-4309-94c0-03ca423b9dd1 response_code = 204 uri = /vpc-routes
21282025-01-13T09:39:08.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56535
21292025-01-13T09:39:08.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56535 req_id = 1e25f6f2-6d04-4c31-801d-c36a754fde96 response_code = 200 uri = /v2p
21302025-01-13T09:39:08.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57576
21312025-01-13T09:39:08.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57576 req_id = 668ffed1-409b-4adb-83d8-23aff78b20e1 response_code = 200 uri = /v2p
21322025-01-13T09:39:08.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36218
21332025-01-13T09:39:08.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36218 req_id = ffa52d86-20b5-4a7b-8711-67005f8b9d1f response_code = 200 uri = /vpc-routes
21342025-01-13T09:39:08.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44414
21352025-01-13T09:39:08.820ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21362025-01-13T09:39:08.873ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21372025-01-13T09:39:08.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44414 req_id = 7298ceec-a94a-44df-8aca-b6b7ee76c93b response_code = 204 uri = /switch-ports
21382025-01-13T09:39:08.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35140
21392025-01-13T09:39:08.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21402025-01-13T09:39:08.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
21412025-01-13T09:39:08.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36218 req_id = 444e5ece-d32b-4524-b485-e2b39c0bdbc7 response_code = 204 uri = /eip-gateways
21422025-01-13T09:39:08.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44414 req_id = 64aa6507-20f3-4c6a-b7b0-75304c40cf63 response_code = 200 uri = /network-bootstore-config
21432025-01-13T09:39:08.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51970
21442025-01-13T09:39:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51970 req_id = 7c463785-5e18-4216-bade-0c33802e8b7d response_code = 200 uri = /vpc-routes
21452025-01-13T09:39:08.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36218 req_id = 6dfb5a31-51c4-48ff-a302-ea8b24a9351c response_code = 204 uri = /vpc-routes
21462025-01-13T09:39:08.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21472025-01-13T09:39:09.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
21482025-01-13T09:39:09.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51970 req_id = 7511bae2-46b0-402d-a63b-3b6711338772 response_code = 204 uri = /eip-gateways
21492025-01-13T09:39:09.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51970 req_id = 0c560a26-d817-4b4c-b1e0-d7a74ada3c57 response_code = 204 uri = /vpc-routes
21502025-01-13T09:39:09.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35140 req_id = 343ced02-932d-4297-880b-9cb359c55983 response_code = 204 uri = /switch-ports
21512025-01-13T09:39:09.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35140 req_id = d668b28b-0977-4739-9347-e3fb5325d1ae response_code = 200 uri = /network-bootstore-config
21522025-01-13T09:39:09.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38788
21532025-01-13T09:39:09.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38788 req_id = b7793fcb-c07a-418c-a271-88bc99f52f6e response_code = 200 uri = /v2p
21542025-01-13T09:39:09.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42393
21552025-01-13T09:39:09.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21562025-01-13T09:39:09.156ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21572025-01-13T09:39:09.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91930 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42393 req_id = dcbf67a2-73e5-4642-a6cd-22adda0aac87 response_code = 204 uri = /switch-ports
21582025-01-13T09:39:09.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42393 req_id = f7a10134-a3d1-49dd-a1c5-0b4065196c61 response_code = 200 uri = /network-bootstore-config
21592025-01-13T09:39:19.027ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7798 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = ab82c7b8-04e3-4e22-b92c-eb620ff322f3 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
21602025-01-13T09:39:19.461ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62228
21612025-01-13T09:39:19.461ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62228 req_id = bb7949eb-44a5-484b-9854-7b929279f094 response_code = 200 uri = /baseboard
21622025-01-13T09:39:38.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64491
21632025-01-13T09:39:38.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64491 req_id = fd688599-ef75-49ca-81a4-bf9b119d53b9 response_code = 200 uri = /vpc-routes
21642025-01-13T09:39:38.702ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
21652025-01-13T09:39:38.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64491 req_id = 70b5df09-7326-4dc7-b6a7-7c3adac9588b response_code = 204 uri = /eip-gateways
21662025-01-13T09:39:38.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64491 req_id = f5f0a15b-4788-43ad-8231-8050d1cc7747 response_code = 204 uri = /vpc-routes
21672025-01-13T09:39:38.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55799
21682025-01-13T09:39:38.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55799 req_id = b7a80e68-11b8-4b1b-b9d0-def70f74a939 response_code = 200 uri = /vpc-routes
21692025-01-13T09:39:38.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
21702025-01-13T09:39:38.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55799 req_id = 554ce5c9-d1ba-45ae-abd5-45cdb51ac9da response_code = 204 uri = /eip-gateways
21712025-01-13T09:39:38.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55799 req_id = 62076058-a779-4b17-b07a-f0455cc82cb9 response_code = 204 uri = /vpc-routes
21722025-01-13T09:39:39.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53568
21732025-01-13T09:39:39.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53568 req_id = ae2b7729-fc1e-4abd-8c6e-6161531994d2 response_code = 200 uri = /v2p
21742025-01-13T09:39:39.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39537
21752025-01-13T09:39:39.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39537 req_id = 7f03aa28-8094-4f9e-af6b-dd36e944e0bd response_code = 200 uri = /v2p
21762025-01-13T09:39:39.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61820
21772025-01-13T09:39:39.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21782025-01-13T09:39:39.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21792025-01-13T09:39:39.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61820 req_id = f7b20cda-04da-4fd9-8bb4-499dd530c751 response_code = 204 uri = /switch-ports
21802025-01-13T09:39:39.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51331
21812025-01-13T09:39:39.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38845
21822025-01-13T09:39:39.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64724
21832025-01-13T09:39:39.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61820 req_id = 3502fbcf-ee1b-4de8-8127-ef4ae10b4660 response_code = 200 uri = /network-bootstore-config
21842025-01-13T09:39:39.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51331 req_id = ebefc60e-cb82-4419-b013-12d71d3141d5 response_code = 200 uri = /vpc-routes
21852025-01-13T09:39:39.267ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21862025-01-13T09:39:39.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38845 req_id = c1009d68-05ed-41c3-99a9-c593c25f801e response_code = 200 uri = /v2p
21872025-01-13T09:39:39.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56362
21882025-01-13T09:39:39.279ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21892025-01-13T09:39:39.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21902025-01-13T09:39:39.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21912025-01-13T09:39:39.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21922025-01-13T09:39:39.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21932025-01-13T09:39:39.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21942025-01-13T09:39:39.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21952025-01-13T09:39:39.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56362 req_id = b54d8126-534b-4395-8f5c-517bf1386dfc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21962025-01-13T09:39:39.310ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21972025-01-13T09:39:39.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37315
21982025-01-13T09:39:39.315ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21992025-01-13T09:39:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22002025-01-13T09:39:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22012025-01-13T09:39:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22022025-01-13T09:39:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22032025-01-13T09:39:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22042025-01-13T09:39:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22052025-01-13T09:39:39.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37315 req_id = 0d03513d-c75b-48fd-a4db-6f16cc2b5c8d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22062025-01-13T09:39:39.318ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
22072025-01-13T09:39:39.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51331 req_id = 12543541-0dd2-4c76-b30b-f07888bc334d response_code = 204 uri = /eip-gateways
22082025-01-13T09:39:39.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51331 req_id = f820c505-0f16-42d4-a842-c9dd933cead7 response_code = 204 uri = /vpc-routes
22092025-01-13T09:39:39.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64724 req_id = 10c084de-8ace-4e47-ae97-bf998d765e05 response_code = 204 uri = /switch-ports
22102025-01-13T09:39:39.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64724 req_id = 78693aa9-1110-4e60-b9c0-1ef3abff15bd response_code = 200 uri = /network-bootstore-config
22112025-01-13T09:39:39.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50370
22122025-01-13T09:39:39.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22132025-01-13T09:39:39.416ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22142025-01-13T09:39:39.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50370 req_id = 805c74fa-d093-492d-a5fa-5757ec74804b response_code = 204 uri = /switch-ports
22152025-01-13T09:39:39.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56096
22162025-01-13T09:39:39.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50370 req_id = e97f982a-6e7d-441f-87da-fe071fcc37ac response_code = 200 uri = /network-bootstore-config
22172025-01-13T09:39:39.469ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22182025-01-13T09:39:39.469ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22192025-01-13T09:39:39.469ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22202025-01-13T09:39:39.469ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22212025-01-13T09:39:39.469ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22222025-01-13T09:39:39.469ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22232025-01-13T09:39:39.469ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22242025-01-13T09:39:39.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56096 req_id = bdbe7af1-0473-4117-b963-bac0e83c39dd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22252025-01-13T09:39:49.026ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7028 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 32c0026d-ff5a-4650-a3fa-1af1c7b960c4 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
22262025-01-13T09:39:49.495ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63072
22272025-01-13T09:39:49.495ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63072 req_id = 214ee209-f0b1-469f-9ed4-f989c650aca5 response_code = 200 uri = /baseboard
22282025-01-13T09:40:08.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33678
22292025-01-13T09:40:08.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33678 req_id = 14235925-8763-48a6-aa5e-b534b38c1e10 response_code = 200 uri = /vpc-routes
22302025-01-13T09:40:08.606ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
22312025-01-13T09:40:08.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33678 req_id = c7b31ab6-e3bc-4736-8d88-094be5a9c748 response_code = 204 uri = /eip-gateways
22322025-01-13T09:40:08.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33678 req_id = ac4916ad-11ad-4192-911a-9af64c4384bd response_code = 204 uri = /vpc-routes
22332025-01-13T09:40:08.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38862
22342025-01-13T09:40:08.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38862 req_id = 3a597fe1-671a-4ebf-bcba-62893ac8e46f response_code = 200 uri = /vpc-routes
22352025-01-13T09:40:08.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58885
22362025-01-13T09:40:08.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58885 req_id = 246582c2-bebc-4f4d-b6a7-a6ee706989ee response_code = 200 uri = /v2p
22372025-01-13T09:40:08.814ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
22382025-01-13T09:40:08.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38862 req_id = 77d4f962-57f6-4a86-8c04-593cbb9285ac response_code = 204 uri = /eip-gateways
22392025-01-13T09:40:08.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38862 req_id = 83a30222-2a95-4fbf-9c43-24dbb0f4a1a6 response_code = 204 uri = /vpc-routes
22402025-01-13T09:40:08.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33568
22412025-01-13T09:40:08.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33568 req_id = 8084a823-341a-4570-9f5e-49047d26f8a3 response_code = 200 uri = /v2p
22422025-01-13T09:40:08.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35077
22432025-01-13T09:40:08.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22442025-01-13T09:40:08.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22452025-01-13T09:40:08.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35077 req_id = 83bd872d-88d2-48f3-91dc-6cbc73464a4e response_code = 204 uri = /switch-ports
22462025-01-13T09:40:08.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52213
22472025-01-13T09:40:08.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22482025-01-13T09:40:09.027ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22492025-01-13T09:40:09.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98670 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52213 req_id = 11d3d536-fd14-422b-b4ba-728a0a86cbdd response_code = 204 uri = /switch-ports
22502025-01-13T09:40:09.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36844
22512025-01-13T09:40:09.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35077 req_id = 2136f24a-6fc4-4616-8b00-ab2b165a8c9e response_code = 200 uri = /network-bootstore-config
22522025-01-13T09:40:09.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52213 req_id = a5bd0dad-e9db-447b-af99-153616cf3721 response_code = 200 uri = /network-bootstore-config
22532025-01-13T09:40:09.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36844 req_id = afdd4fdc-a6c7-47df-8619-7ff7d98cacd1 response_code = 200 uri = /vpc-routes
22542025-01-13T09:40:09.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34892
22552025-01-13T09:40:09.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34892 req_id = e9b98089-0c01-4332-9d2d-32a6827b35f4 response_code = 200 uri = /v2p
22562025-01-13T09:40:09.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
22572025-01-13T09:40:09.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36844 req_id = 35d77b3a-98ad-41b0-a0fd-3e79f2006267 response_code = 204 uri = /eip-gateways
22582025-01-13T09:40:09.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36844 req_id = d07af086-ee94-4cb6-b242-0d8eff3ef38d response_code = 204 uri = /vpc-routes
22592025-01-13T09:40:09.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52463
22602025-01-13T09:40:09.144ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22612025-01-13T09:40:09.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22622025-01-13T09:40:09.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86015 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52463 req_id = 965895a2-32ef-4498-a732-c14d6755a8f4 response_code = 204 uri = /switch-ports
22632025-01-13T09:40:09.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52463 req_id = 4cdf1481-d1ec-44aa-a01b-ee3f5b54440b response_code = 200 uri = /network-bootstore-config
22642025-01-13T09:40:19.026ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7106 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 2449eb96-b80f-4a63-9f5e-7d9b57e0800d response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
22652025-01-13T09:40:19.529ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43670
22662025-01-13T09:40:19.529ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43670 req_id = 63940f15-ab27-4d66-93f1-df46442c3bf5 response_code = 200 uri = /baseboard
22672025-01-13T09:40:38.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51031
22682025-01-13T09:40:38.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51031 req_id = 6c3ae00b-32e0-4ebb-9866-ca750fd53b0f response_code = 200 uri = /vpc-routes
22692025-01-13T09:40:38.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54121
22702025-01-13T09:40:38.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54121 req_id = 9fa594f8-bfee-4717-b30c-a04384874674 response_code = 200 uri = /v2p
22712025-01-13T09:40:38.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
22722025-01-13T09:40:38.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51031 req_id = d973a2a3-1b5b-4ff3-a06b-00bdce47eb7b response_code = 204 uri = /eip-gateways
22732025-01-13T09:40:38.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51031 req_id = 97ff2a54-2c83-4f19-9fea-972525e98903 response_code = 204 uri = /vpc-routes
22742025-01-13T09:40:38.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39637
22752025-01-13T09:40:38.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39637 req_id = 028efc5f-eb71-459e-88e0-9b486aeb4ff2 response_code = 200 uri = /vpc-routes
22762025-01-13T09:40:39.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61054
22772025-01-13T09:40:39.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61054 req_id = 5ada1f6f-bb0a-4a40-87a8-b84281bb1bdb response_code = 200 uri = /v2p
22782025-01-13T09:40:39.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39075
22792025-01-13T09:40:39.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22802025-01-13T09:40:39.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22812025-01-13T09:40:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112228 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39075 req_id = d3d2a5ba-9cf8-4d7d-87d5-20bc4b9b2d2a response_code = 204 uri = /switch-ports
22822025-01-13T09:40:39.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44506
22832025-01-13T09:40:39.130ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22842025-01-13T09:40:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39075 req_id = 51d88297-91d0-4594-aded-0403ad08fe90 response_code = 200 uri = /network-bootstore-config
22852025-01-13T09:40:39.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
22862025-01-13T09:40:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39637 req_id = 9d830968-379a-4150-98fb-20b3b02039e6 response_code = 204 uri = /eip-gateways
22872025-01-13T09:40:39.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39637 req_id = b78744ef-15e7-4199-9074-3562c03a8e79 response_code = 204 uri = /vpc-routes
22882025-01-13T09:40:39.167ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22892025-01-13T09:40:39.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39673
22902025-01-13T09:40:39.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39673 req_id = f48d4975-6e69-453b-9396-978662bc1a6e response_code = 200 uri = /vpc-routes
22912025-01-13T09:40:39.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44506 req_id = 6c4b9c92-cde1-431d-8070-5a3985ba38f1 response_code = 204 uri = /switch-ports
22922025-01-13T09:40:39.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44506 req_id = 9f55ee10-8181-45b9-8e0c-b2061951c6db response_code = 200 uri = /network-bootstore-config
22932025-01-13T09:40:39.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
22942025-01-13T09:40:39.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39673 req_id = 0db20427-69d0-48b0-b04a-e1397b154c33 response_code = 204 uri = /eip-gateways
22952025-01-13T09:40:39.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56608
22962025-01-13T09:40:39.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56608 req_id = 0d1c4066-ee89-4809-b893-043be7affdb6 response_code = 200 uri = /v2p
22972025-01-13T09:40:39.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39673 req_id = 41be328e-7ae3-4477-b9d3-c6370a4fdb8e response_code = 204 uri = /vpc-routes
22982025-01-13T09:40:39.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43994
22992025-01-13T09:40:39.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23002025-01-13T09:40:39.507ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23012025-01-13T09:40:39.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43994 req_id = a8a6824b-ba14-4e05-bc76-b78ff90611c1 response_code = 204 uri = /switch-ports
23022025-01-13T09:40:39.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43994 req_id = 370a92da-b84f-42a2-87b0-9cdc2e252059 response_code = 200 uri = /network-bootstore-config
23032025-01-13T09:40:49.024ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6694 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = fe28d28d-0acc-4576-9190-5f698a716d66 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
23042025-01-13T09:40:49.561ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53928
23052025-01-13T09:40:49.561ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53928 req_id = 6bd98dc6-e4d4-4179-8a48-6081d6138784 response_code = 200 uri = /baseboard
23062025-01-13T09:41:08.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44771
23072025-01-13T09:41:08.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44771 req_id = 9dc31269-103f-4a6d-8c02-6846ff3025cb response_code = 200 uri = /vpc-routes
23082025-01-13T09:41:08.598ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23092025-01-13T09:41:08.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44771 req_id = 6108172b-61b1-4bfd-a8f9-681ac204172b response_code = 204 uri = /eip-gateways
23102025-01-13T09:41:08.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44771 req_id = ceb1a530-07fa-49be-bdca-9ff2c5fbc54b response_code = 204 uri = /vpc-routes
23112025-01-13T09:41:08.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55166
23122025-01-13T09:41:08.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55166 req_id = 8af6b583-281c-4898-b251-240c26db0c58 response_code = 200 uri = /vpc-routes
23132025-01-13T09:41:08.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64290
23142025-01-13T09:41:08.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64290 req_id = e149ebce-6484-474d-9423-0f071938194d response_code = 200 uri = /v2p
23152025-01-13T09:41:08.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23162025-01-13T09:41:08.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55166 req_id = 6896f0ee-64a8-47e7-8797-386bc8afc3c6 response_code = 204 uri = /eip-gateways
23172025-01-13T09:41:08.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55166 req_id = 558075c3-b38f-41e3-9ddb-e759731911ac response_code = 204 uri = /vpc-routes
23182025-01-13T09:41:08.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52900
23192025-01-13T09:41:08.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52900 req_id = ab5e8448-1174-4a1c-b42d-3e4e00e432ff response_code = 200 uri = /v2p
23202025-01-13T09:41:08.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60439
23212025-01-13T09:41:08.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23222025-01-13T09:41:08.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23232025-01-13T09:41:08.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60439 req_id = d4445717-40c1-4427-bed6-7697897db8c7 response_code = 204 uri = /switch-ports
23242025-01-13T09:41:08.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52107
23252025-01-13T09:41:08.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23262025-01-13T09:41:08.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60439 req_id = b4a7aa2e-5547-4e5a-8d5e-7134c00a4da1 response_code = 200 uri = /network-bootstore-config
23272025-01-13T09:41:08.963ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23282025-01-13T09:41:09.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95788 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52107 req_id = c432d85b-9f32-4e45-a693-2528ccd5ec48 response_code = 204 uri = /switch-ports
23292025-01-13T09:41:09.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52107 req_id = f99d610c-f5bf-4f8d-8d9e-de3dcde9be89 response_code = 200 uri = /network-bootstore-config
23302025-01-13T09:41:09.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64285
23312025-01-13T09:41:09.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64285 req_id = 6e49f2c1-7427-4c93-9be9-6657eaad9671 response_code = 200 uri = /vpc-routes
23322025-01-13T09:41:09.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23332025-01-13T09:41:09.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64285 req_id = 3de2ee23-67ff-44c9-bd83-74054ae25642 response_code = 204 uri = /eip-gateways
23342025-01-13T09:41:09.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63198
23352025-01-13T09:41:09.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63198 req_id = 4d8e2a1d-93ac-41c3-942b-3cd091dd23ae response_code = 200 uri = /v2p
23362025-01-13T09:41:09.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64285 req_id = 5bd05d8e-3556-405e-8327-ced76428f33b response_code = 204 uri = /vpc-routes
23372025-01-13T09:41:09.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39797
23382025-01-13T09:41:09.399ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23392025-01-13T09:41:09.437ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23402025-01-13T09:41:09.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90610 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39797 req_id = 9ea4390a-6977-4220-a14e-88c2a431eafb response_code = 204 uri = /switch-ports
23412025-01-13T09:41:09.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39797 req_id = 790d6bd1-f5e2-4404-b1f3-8fceb8b02255 response_code = 200 uri = /network-bootstore-config
23422025-01-13T09:41:19.024ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6972 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 2c308a59-bf7b-49f1-a707-b5090795199d response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
23432025-01-13T09:41:19.594ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65518
23442025-01-13T09:41:19.594ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65518 req_id = 39ebcb02-1c3a-4a71-9a46-f5cf6e16df9f response_code = 200 uri = /baseboard
23452025-01-13T09:41:38.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37811
23462025-01-13T09:41:38.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37811 req_id = 67314fb0-2e49-4cae-9c0d-32484e104e0e response_code = 200 uri = /vpc-routes
23472025-01-13T09:41:38.723ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23482025-01-13T09:41:38.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37811 req_id = c5f14f08-2eb1-4a74-8ec6-4af4a9d422cf response_code = 204 uri = /eip-gateways
23492025-01-13T09:41:38.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37811 req_id = 74a9b906-4fb1-4f0e-8bf3-4d4a5d77cf26 response_code = 204 uri = /vpc-routes
23502025-01-13T09:41:38.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64175
23512025-01-13T09:41:38.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64175 req_id = f9d62e74-be26-4b36-8f14-854ee45393f1 response_code = 200 uri = /v2p
23522025-01-13T09:41:38.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54062
23532025-01-13T09:41:38.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23542025-01-13T09:41:38.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23552025-01-13T09:41:38.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134729 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54062 req_id = bb398d20-435f-4121-94ac-ed4b72b46cd1 response_code = 204 uri = /switch-ports
23562025-01-13T09:41:38.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60189
23572025-01-13T09:41:38.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51240
23582025-01-13T09:41:38.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51240 req_id = f5f42c05-95ec-4543-bbbf-ed4ff879ebd9 response_code = 200 uri = /v2p
23592025-01-13T09:41:38.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60189 req_id = 9e58f749-4028-403b-9077-18d3390f4659 response_code = 200 uri = /vpc-routes
23602025-01-13T09:41:38.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54062 req_id = 744131c2-bdc2-4ac1-bcaa-b8dbe56ee1f8 response_code = 200 uri = /network-bootstore-config
23612025-01-13T09:41:39.039ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23622025-01-13T09:41:39.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60189 req_id = 91094bbe-1d01-439b-8d87-e43ce9b3fefd response_code = 204 uri = /eip-gateways
23632025-01-13T09:41:39.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60189 req_id = 22ada3ac-dbac-4f1e-a10f-ee4d842d2abb response_code = 204 uri = /vpc-routes
23642025-01-13T09:41:39.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54970
23652025-01-13T09:41:39.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23662025-01-13T09:41:39.097ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23672025-01-13T09:41:39.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54970 req_id = 1f8fc80e-3a9c-4601-9bd7-3c975c33f006 response_code = 204 uri = /switch-ports
23682025-01-13T09:41:39.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54970 req_id = 9bf49ed9-9d80-423d-a4b5-2110db0d7e5c response_code = 200 uri = /network-bootstore-config
23692025-01-13T09:41:39.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38739
23702025-01-13T09:41:39.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38739 req_id = b9da3451-8066-49a4-85a2-168e8ee1d8c3 response_code = 200 uri = /vpc-routes
23712025-01-13T09:41:39.241ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23722025-01-13T09:41:39.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38739 req_id = a9e0acec-3557-4e74-8db8-8e6605c225ee response_code = 204 uri = /eip-gateways
23732025-01-13T09:41:39.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38739 req_id = aef39283-c377-48c9-a877-0fa9fa8db1a5 response_code = 204 uri = /vpc-routes
23742025-01-13T09:41:39.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35662
23752025-01-13T09:41:39.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35662 req_id = 7c981a99-e802-4e33-b034-4938f4af3b89 response_code = 200 uri = /v2p
23762025-01-13T09:41:39.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54987
23772025-01-13T09:41:39.388ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23782025-01-13T09:41:39.424ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23792025-01-13T09:41:39.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89155 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54987 req_id = 5eea562c-5481-4d2c-90ec-e3adf9b33e65 response_code = 204 uri = /switch-ports
23802025-01-13T09:41:39.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54987 req_id = 92de765e-a9bc-48b0-b951-1c3743bf8f93 response_code = 200 uri = /network-bootstore-config
23812025-01-13T09:41:49.025ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7259 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = e992a8e5-2873-434b-9cdb-9a5833e34dfc response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
23822025-01-13T09:41:49.627ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59510
23832025-01-13T09:41:49.627ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59510 req_id = 6780e745-e6f1-4f74-a821-97117fe8b538 response_code = 200 uri = /baseboard
23842025-01-13T09:42:08.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41708
23852025-01-13T09:42:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41708 req_id = 1bd4d91c-62bf-46f7-9508-be9efa2eaeb5 response_code = 200 uri = /vpc-routes
23862025-01-13T09:42:08.655ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23872025-01-13T09:42:08.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41708 req_id = d32bbb00-d294-4554-8537-b45aba913455 response_code = 204 uri = /eip-gateways
23882025-01-13T09:42:08.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57278
23892025-01-13T09:42:08.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57278 req_id = a8c7b15f-f639-433a-85a0-b9ccfe6216a7 response_code = 200 uri = /v2p
23902025-01-13T09:42:08.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41708 req_id = b5f981a5-02ee-42e7-8520-5a6101bcee46 response_code = 204 uri = /vpc-routes
23912025-01-13T09:42:08.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46256
23922025-01-13T09:42:08.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46256 req_id = 310644fe-fdf5-40cd-b577-e506f510c084 response_code = 200 uri = /vpc-routes
23932025-01-13T09:42:08.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
23942025-01-13T09:42:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46256 req_id = c687f187-6b9b-4f0e-ab22-88e1a69339c1 response_code = 204 uri = /eip-gateways
23952025-01-13T09:42:08.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46256 req_id = ee152293-8f44-4e56-9f77-fa2f515c887c response_code = 204 uri = /vpc-routes
23962025-01-13T09:42:08.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45934
23972025-01-13T09:42:08.837ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23982025-01-13T09:42:08.887ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23992025-01-13T09:42:08.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126906 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45934 req_id = 5f21b16c-486e-4db9-9757-175f56e3719b response_code = 204 uri = /switch-ports
24002025-01-13T09:42:08.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39772
24012025-01-13T09:42:08.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47924
24022025-01-13T09:42:08.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24032025-01-13T09:42:08.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3790 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45934 req_id = ff9c2ac4-1619-47eb-a4c0-c3c9ee61c0e5 response_code = 200 uri = /network-bootstore-config
24042025-01-13T09:42:08.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39772 req_id = 30804eaa-6a81-43f2-92cc-32bd72a1a5ea response_code = 200 uri = /v2p
24052025-01-13T09:42:09.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24062025-01-13T09:42:09.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44992
24072025-01-13T09:42:09.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44992 req_id = 5fbf06e1-1a92-4250-b258-5b04be943543 response_code = 200 uri = /vpc-routes
24082025-01-13T09:42:09.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96475 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47924 req_id = 55fdfa60-7754-46c6-87ab-872be62968f8 response_code = 204 uri = /switch-ports
24092025-01-13T09:42:09.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47924 req_id = ef0fb93d-3629-4a1e-b313-f16c671573e1 response_code = 200 uri = /network-bootstore-config
24102025-01-13T09:42:09.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
24112025-01-13T09:42:09.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44992 req_id = c252ce86-b759-4224-9db5-76f8b8825c78 response_code = 204 uri = /eip-gateways
24122025-01-13T09:42:09.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60420
24132025-01-13T09:42:09.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60420 req_id = e9251636-824d-4785-b38b-db7d4f32d13a response_code = 200 uri = /v2p
24142025-01-13T09:42:09.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44992 req_id = f3e05323-7d2b-4251-b9cf-cc5b4e8e1907 response_code = 204 uri = /vpc-routes
24152025-01-13T09:42:09.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38000
24162025-01-13T09:42:09.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24172025-01-13T09:42:09.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24182025-01-13T09:42:09.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38000 req_id = b3102e63-9cd0-4d0d-bab5-e2364ed12003 response_code = 204 uri = /switch-ports
24192025-01-13T09:42:09.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38000 req_id = 79d93883-43a9-45f5-81d5-2720c5cc0964 response_code = 200 uri = /network-bootstore-config
24202025-01-13T09:42:19.025ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7476 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 0183ca70-4e45-48fa-828d-f577e5933229 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
24212025-01-13T09:42:19.659ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53113
24222025-01-13T09:42:19.659ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53113 req_id = 0ba0586a-fc01-4a1b-b098-4db4aae2a9ad response_code = 200 uri = /baseboard
24232025-01-13T09:42:23.269ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24242025-01-13T09:42:23.270ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24252025-01-13T09:42:23.297ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 5253, tv_nsec: 586549525 } time_to_next_cleanup = 599.9999958s
24262025-01-13T09:42:37.381ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24272025-01-13T09:42:38.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53373
24282025-01-13T09:42:38.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53373 req_id = be02d038-83fc-4e7d-8474-67cb83e188b4 response_code = 200 uri = /vpc-routes
24292025-01-13T09:42:38.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
24302025-01-13T09:42:38.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53373 req_id = b3de58be-7d25-4582-92c2-c36ffd865d27 response_code = 204 uri = /eip-gateways
24312025-01-13T09:42:38.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53373 req_id = 99b027d1-364b-40ea-8669-94a195f9ff54 response_code = 204 uri = /vpc-routes
24322025-01-13T09:42:38.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38701
24332025-01-13T09:42:38.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38701 req_id = d5a51298-75f0-4828-a6f7-6552ba332f52 response_code = 200 uri = /v2p
24342025-01-13T09:42:38.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47630
24352025-01-13T09:42:38.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47630 req_id = a1bca9df-fe14-4750-9c0d-cd57f843207a response_code = 200 uri = /v2p
24362025-01-13T09:42:38.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56785
24372025-01-13T09:42:38.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56785 req_id = 13fd1550-b994-482e-b223-30addd018af7 response_code = 200 uri = /vpc-routes
24382025-01-13T09:42:38.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
24392025-01-13T09:42:38.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56785 req_id = 8a4bf59a-01a8-4ae5-8c17-20ee25cd5110 response_code = 204 uri = /eip-gateways
24402025-01-13T09:42:38.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56785 req_id = daafd6a8-7014-450c-ab32-3f4f75c02701 response_code = 204 uri = /vpc-routes
24412025-01-13T09:42:39.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42391
24422025-01-13T09:42:39.000ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24432025-01-13T09:42:39.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24442025-01-13T09:42:39.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42391 req_id = e1bf5aed-dd85-425d-a5e2-43ef95a7245b response_code = 204 uri = /switch-ports
24452025-01-13T09:42:39.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43478
24462025-01-13T09:42:39.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52893
24472025-01-13T09:42:39.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43478 req_id = b17e1410-d25f-4f6b-a650-6e1da81f32b9 response_code = 200 uri = /vpc-routes
24482025-01-13T09:42:39.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42391 req_id = 6e4d03b1-e167-4136-9ba4-95ef76e9c4cd response_code = 200 uri = /network-bootstore-config
24492025-01-13T09:42:39.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24502025-01-13T09:42:39.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24512025-01-13T09:42:39.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
24522025-01-13T09:42:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 698 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43478 req_id = d07805a7-de6a-4fb2-88e0-fd0ae4948715 response_code = 204 uri = /eip-gateways
24532025-01-13T09:42:39.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52893 req_id = 6071f23d-90c2-412c-9338-4a61ff7f87f7 response_code = 204 uri = /switch-ports
24542025-01-13T09:42:39.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52893 req_id = 33377a9d-c309-42d8-8e55-08e4ef478cd7 response_code = 200 uri = /network-bootstore-config
24552025-01-13T09:42:39.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57391
24562025-01-13T09:42:39.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57391 req_id = 12cfb092-8157-49d6-a944-3442e2b02830 response_code = 200 uri = /v2p
24572025-01-13T09:42:39.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43478 req_id = 9779ac5d-ed16-4f3c-bc6c-53ca876aa0d3 response_code = 204 uri = /vpc-routes
24582025-01-13T09:42:39.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64696
24592025-01-13T09:42:39.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24602025-01-13T09:42:39.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24612025-01-13T09:42:39.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64696 req_id = 8eb4c1e2-0a5a-49a9-abc8-d50164664ef9 response_code = 204 uri = /switch-ports
24622025-01-13T09:42:39.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64696 req_id = ad01d836-4a75-4c85-a814-f08dacec5b25 response_code = 200 uri = /network-bootstore-config
24632025-01-13T09:42:49.024ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7249 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 9f0da351-47fb-4cb9-ae72-a4660798f15d response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
24642025-01-13T09:42:49.692ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37475
24652025-01-13T09:42:49.692ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37475 req_id = c3f46334-b4d1-4060-bdf5-708d44576fe6 response_code = 200 uri = /baseboard
24662025-01-13T09:43:08.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63074
24672025-01-13T09:43:08.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63074 req_id = d3bceb09-8954-4085-b80a-48fa7f911b3d response_code = 200 uri = /vpc-routes
24682025-01-13T09:43:08.588ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
24692025-01-13T09:43:08.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63074 req_id = e622f04a-5dbb-40e8-9e68-baa031ceaa16 response_code = 204 uri = /eip-gateways
24702025-01-13T09:43:08.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63074 req_id = ddeca495-7a58-46ad-b57e-b379a88b4455 response_code = 204 uri = /vpc-routes
24712025-01-13T09:43:08.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48755
24722025-01-13T09:43:08.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48755 req_id = 1b2dac32-aa90-4b49-aa0c-5013cc266707 response_code = 200 uri = /v2p
24732025-01-13T09:43:08.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44038
24742025-01-13T09:43:08.705ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24752025-01-13T09:43:08.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24762025-01-13T09:43:08.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94782 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44038 req_id = f6688536-2063-47ff-b2a6-a4d7418eb36a response_code = 204 uri = /switch-ports
24772025-01-13T09:43:08.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55259
24782025-01-13T09:43:08.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47843
24792025-01-13T09:43:08.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55259 req_id = 7899760d-0abb-47d7-b0a1-ca7744ee518c response_code = 200 uri = /vpc-routes
24802025-01-13T09:43:08.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44038 req_id = 10f29de5-13e5-4f88-beb0-1ab5868ecd3c response_code = 200 uri = /network-bootstore-config
24812025-01-13T09:43:08.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47843 req_id = 23ced17a-3cb5-402e-8835-0983459d8d1e response_code = 200 uri = /v2p
24822025-01-13T09:43:08.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
24832025-01-13T09:43:08.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1065 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55259 req_id = ad89eea6-818f-466d-a1be-df2de936f778 response_code = 204 uri = /eip-gateways
24842025-01-13T09:43:08.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41960
24852025-01-13T09:43:08.868ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24862025-01-13T09:43:08.923ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24872025-01-13T09:43:08.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41960 req_id = fdbd308a-7eed-41a4-946a-9e12b0a28c5e response_code = 204 uri = /switch-ports
24882025-01-13T09:43:08.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55259 req_id = df65c402-5a5c-49bd-9bd0-3fea94775bd1 response_code = 204 uri = /vpc-routes
24892025-01-13T09:43:08.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41960 req_id = 64e24213-bd20-48c4-8d39-efef194b910c response_code = 200 uri = /network-bootstore-config
24902025-01-13T09:43:09.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44062
24912025-01-13T09:43:09.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44062 req_id = 2a3916f4-f7e0-499e-b14f-22fdec325226 response_code = 200 uri = /vpc-routes
24922025-01-13T09:43:09.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
24932025-01-13T09:43:09.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44062 req_id = eaf49c23-4d57-4adf-a296-87dcf9a75436 response_code = 204 uri = /eip-gateways
24942025-01-13T09:43:09.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44062 req_id = 8db47bc6-bab3-4c95-bb77-5d3765715850 response_code = 204 uri = /vpc-routes
24952025-01-13T09:43:09.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57892
24962025-01-13T09:43:09.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57892 req_id = d2cee38f-6a5f-4f43-b383-398821bf2264 response_code = 200 uri = /v2p
24972025-01-13T09:43:09.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42203
24982025-01-13T09:43:09.309ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24992025-01-13T09:43:09.347ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25002025-01-13T09:43:09.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42203 req_id = 8e55b35e-d61a-4741-9d50-503eb6f68b94 response_code = 204 uri = /switch-ports
25012025-01-13T09:43:09.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42203 req_id = 0c708cdf-68ba-499b-acd8-08d3c7610654 response_code = 200 uri = /network-bootstore-config
25022025-01-13T09:43:19.023ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6842 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 19d5b799-beba-43c0-ac84-32b39792b101 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
25032025-01-13T09:43:19.723ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32802
25042025-01-13T09:43:19.724ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32802 req_id = c21a3e9c-65da-4025-b619-640af352c7b8 response_code = 200 uri = /baseboard
25052025-01-13T09:43:38.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54035
25062025-01-13T09:43:38.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54035 req_id = 4a59d712-20c2-436f-a095-cbdebcae9d55 response_code = 200 uri = /vpc-routes
25072025-01-13T09:43:38.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
25082025-01-13T09:43:38.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54035 req_id = dc38b648-9f84-471c-a032-cd6a0f328b74 response_code = 204 uri = /eip-gateways
25092025-01-13T09:43:38.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36584
25102025-01-13T09:43:38.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36584 req_id = 2d774c28-7e63-44a9-97cf-b3f06dcb20b5 response_code = 200 uri = /v2p
25112025-01-13T09:43:38.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54035 req_id = fbc4952b-8f43-4a02-88a2-8cd73a5e2b89 response_code = 204 uri = /vpc-routes
25122025-01-13T09:43:38.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56939
25132025-01-13T09:43:38.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56939 req_id = 32b838fa-37e9-453d-a438-a0f2655d6008 response_code = 200 uri = /vpc-routes
25142025-01-13T09:43:38.928ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
25152025-01-13T09:43:38.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56939 req_id = ba2491eb-de34-43cb-b5fe-799f7eed099f response_code = 204 uri = /eip-gateways
25162025-01-13T09:43:38.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56939 req_id = 2f6066d5-1c6e-4d38-8da7-67f5081972bc response_code = 204 uri = /vpc-routes
25172025-01-13T09:43:38.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43215
25182025-01-13T09:43:38.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25192025-01-13T09:43:38.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25202025-01-13T09:43:39.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43215 req_id = e6a5997a-14e8-482f-b42d-cff4e90cccaf response_code = 204 uri = /switch-ports
25212025-01-13T09:43:39.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57933
25222025-01-13T09:43:39.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59176
25232025-01-13T09:43:39.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43215 req_id = 9efb3791-36dc-4634-812f-baebbf819af4 response_code = 200 uri = /network-bootstore-config
25242025-01-13T09:43:39.058ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25252025-01-13T09:43:39.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57933 req_id = 5b8570c0-c534-4526-8d48-e579edbbbdc6 response_code = 200 uri = /v2p
25262025-01-13T09:43:39.097ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25272025-01-13T09:43:39.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37917
25282025-01-13T09:43:39.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37917 req_id = bde6bade-913e-4ee9-880d-a3771d5f2300 response_code = 200 uri = /vpc-routes
25292025-01-13T09:43:39.153ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
25302025-01-13T09:43:39.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37917 req_id = 16302491-41a0-4af4-9d9d-a5720683738e response_code = 204 uri = /eip-gateways
25312025-01-13T09:43:39.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37917 req_id = aab92d2c-3eaf-4dfb-be4f-0cc912c82d0b response_code = 204 uri = /vpc-routes
25322025-01-13T09:43:39.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111769 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59176 req_id = b54a2cd7-358e-4362-a9aa-eb9a2cfaad42 response_code = 204 uri = /switch-ports
25332025-01-13T09:43:39.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59176 req_id = 89fb1704-b213-43c0-bcf5-622255f4827e response_code = 200 uri = /network-bootstore-config
25342025-01-13T09:43:39.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38018
25352025-01-13T09:43:39.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38018 req_id = 04401a83-d283-4ea2-8945-f7a67d54d4a0 response_code = 200 uri = /v2p
25362025-01-13T09:43:39.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48856
25372025-01-13T09:43:39.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25382025-01-13T09:43:39.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25392025-01-13T09:43:39.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91549 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48856 req_id = 286cfd7e-2292-40e9-8aa6-e430cc6687b4 response_code = 204 uri = /switch-ports
25402025-01-13T09:43:39.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48856 req_id = f0846238-b12c-4c1d-b6b1-13d272b4f1f1 response_code = 200 uri = /network-bootstore-config
25412025-01-13T09:43:49.023ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7192 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 6a0a110b-dedb-4cf3-a3d0-8c0bdd12a457 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
25422025-01-13T09:43:49.757ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54403
25432025-01-13T09:43:49.757ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54403 req_id = 9153434d-fbc6-4233-85c1-18c89d690908 response_code = 200 uri = /baseboard
25442025-01-13T09:44:08.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62357
25452025-01-13T09:44:08.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62357 req_id = 9025143c-864d-4502-be63-b0cdf028c2cf response_code = 200 uri = /vpc-routes
25462025-01-13T09:44:08.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
25472025-01-13T09:44:08.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62357 req_id = b76cdaf4-b224-42ae-b4de-a0c507c62a3b response_code = 204 uri = /eip-gateways
25482025-01-13T09:44:08.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62357 req_id = 797283f5-7e7c-495c-9024-44368c06dc6f response_code = 204 uri = /vpc-routes
25492025-01-13T09:44:08.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58234
25502025-01-13T09:44:08.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58234 req_id = 23052e65-238d-4a11-97f7-4e4359b712e3 response_code = 200 uri = /v2p
25512025-01-13T09:44:08.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53541
25522025-01-13T09:44:08.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25532025-01-13T09:44:08.793ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25542025-01-13T09:44:08.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145177 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53541 req_id = 2ac91657-5ae7-40e4-a220-3b374d70cf68 response_code = 204 uri = /switch-ports
25552025-01-13T09:44:08.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46676
25562025-01-13T09:44:08.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43378
25572025-01-13T09:44:08.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46676 req_id = 018d766e-b55a-4dd5-a5a4-b9c9e49fdce6 response_code = 200 uri = /vpc-routes
25582025-01-13T09:44:08.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53541 req_id = ec882165-3f68-4ef8-a05f-fd2c3260a929 response_code = 200 uri = /network-bootstore-config
25592025-01-13T09:44:08.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43378 req_id = a37f358d-89ea-4f43-b0c4-186edae3888b response_code = 200 uri = /v2p
25602025-01-13T09:44:08.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38613
25612025-01-13T09:44:08.896ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25622025-01-13T09:44:08.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25632025-01-13T09:44:09.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131593 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38613 req_id = 70b9c3a2-5b0e-47a8-9bd0-de46209b314f response_code = 204 uri = /switch-ports
25642025-01-13T09:44:09.028ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
25652025-01-13T09:44:09.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46676 req_id = 9a6c6111-f5c8-476b-8371-882413b5ce28 response_code = 204 uri = /eip-gateways
25662025-01-13T09:44:09.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38613 req_id = aab9735c-71f2-48a4-8950-4c1917a49741 response_code = 200 uri = /network-bootstore-config
25672025-01-13T09:44:09.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46676 req_id = 138c6248-f88b-43a9-a25b-788591e15dcb response_code = 204 uri = /vpc-routes
25682025-01-13T09:44:09.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52035
25692025-01-13T09:44:09.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52035 req_id = 057a7085-5aae-482f-ab06-3a3ca4e73855 response_code = 200 uri = /vpc-routes
25702025-01-13T09:44:09.238ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
25712025-01-13T09:44:09.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52035 req_id = 7e766724-05c7-4dcf-a505-41edfd371f41 response_code = 204 uri = /eip-gateways
25722025-01-13T09:44:09.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52035 req_id = 1f8321a0-029d-47c9-aac4-2e2738b6e92d response_code = 204 uri = /vpc-routes
25732025-01-13T09:44:09.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44473
25742025-01-13T09:44:09.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25752025-01-13T09:44:09.300ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25762025-01-13T09:44:09.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44473 req_id = 40df1a7d-ebc9-4da1-b557-f7ca01e225bf response_code = 204 uri = /switch-ports
25772025-01-13T09:44:09.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33658
25782025-01-13T09:44:09.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33658 req_id = 04e1adcc-ca6e-411f-b343-514fe9d06730 response_code = 200 uri = /v2p
25792025-01-13T09:44:09.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44473 req_id = c717b652-fcc8-4acd-9a20-5189ae4dfe80 response_code = 200 uri = /network-bootstore-config
25802025-01-13T09:44:19.023ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7119 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = a0846bfd-c193-40db-bdac-2cbeafe2d466 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
25812025-01-13T09:44:19.792ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40296
25822025-01-13T09:44:19.792ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40296 req_id = b8db3f5c-1e60-40c6-b2c4-0f496af5a862 response_code = 200 uri = /baseboard
25832025-01-13T09:44:38.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61626
25842025-01-13T09:44:38.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61626 req_id = be2833a0-77fa-4df0-88b7-a1f859e40e07 response_code = 200 uri = /vpc-routes
25852025-01-13T09:44:38.887ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
25862025-01-13T09:44:38.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61626 req_id = 8ce87529-6983-465c-b4c0-1a5594b589e8 response_code = 204 uri = /eip-gateways
25872025-01-13T09:44:38.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61626 req_id = b89350b7-8795-498b-8e53-5c6d56600b81 response_code = 204 uri = /vpc-routes
25882025-01-13T09:44:39.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47200
25892025-01-13T09:44:39.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47200 req_id = f1df315d-df7f-4511-b3a8-5226238b1d35 response_code = 200 uri = /vpc-routes
25902025-01-13T09:44:39.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49980
25912025-01-13T09:44:39.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49980 req_id = 3d1738c5-1da0-4270-ba61-112a831fdcd5 response_code = 200 uri = /v2p
25922025-01-13T09:44:39.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34769
25932025-01-13T09:44:39.100ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25942025-01-13T09:44:39.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25952025-01-13T09:44:39.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34769 req_id = 6d1bb43a-18d1-4e67-87c0-c9c1e8e35284 response_code = 204 uri = /switch-ports
25962025-01-13T09:44:39.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48537
25972025-01-13T09:44:39.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25982025-01-13T09:44:39.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25992025-01-13T09:44:39.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34769 req_id = 2763c9fa-6638-4a67-8f04-36d109f2ef9c response_code = 200 uri = /network-bootstore-config
26002025-01-13T09:44:39.244ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
26012025-01-13T09:44:39.244ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
26022025-01-13T09:44:39.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47200 req_id = f18310a8-8ffe-4e0a-9fb6-8c5aa12a554b response_code = 204 uri = /eip-gateways
26032025-01-13T09:44:39.246ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
26042025-01-13T09:44:39.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59909
26052025-01-13T09:44:39.253ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26062025-01-13T09:44:39.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26072025-01-13T09:44:39.262ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605
26082025-01-13T09:44:39.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26092025-01-13T09:44:39.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98
26102025-01-13T09:44:39.295ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26112025-01-13T09:44:39.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55109
26122025-01-13T09:44:39.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44029
26132025-01-13T09:44:39.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40133
26142025-01-13T09:44:39.314ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26152025-01-13T09:44:39.314ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26162025-01-13T09:44:39.314ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
26172025-01-13T09:44:39.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44029 req_id = 8996258c-7699-41b0-95eb-257a8d8bd008 response_code = 200 uri = /v2p
26182025-01-13T09:44:39.314ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26192025-01-13T09:44:39.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26202025-01-13T09:44:39.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 692 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47200 req_id = a5a10f1b-768e-4549-8cf8-b61723c36176 response_code = 204 uri = /vpc-routes
26212025-01-13T09:44:39.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26222025-01-13T09:44:39.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26232025-01-13T09:44:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26242025-01-13T09:44:39.315ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
26252025-01-13T09:44:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26262025-01-13T09:44:39.315ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26272025-01-13T09:44:39.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55109 req_id = e6065c62-dd88-4ed3-aa64-6e4e41cfba79 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26282025-01-13T09:44:39.318ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26292025-01-13T09:44:39.318ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c
26302025-01-13T09:44:39.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26312025-01-13T09:44:39.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605
26322025-01-13T09:44:39.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26332025-01-13T09:44:39.364ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98
26342025-01-13T09:44:39.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119570 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59909 req_id = 39637450-16d9-4c88-b8ff-dd25daef9814 response_code = 204 uri = /switch-ports
26352025-01-13T09:44:39.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59909 req_id = 524f3209-587f-42dc-b14d-5a62e52a5d25 response_code = 200 uri = /network-bootstore-config
26362025-01-13T09:44:39.379ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26372025-01-13T09:44:39.379ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22bc846d-e6cf-469c-acea-15b83ef27270
26382025-01-13T09:44:39.395ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26392025-01-13T09:44:39.396ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c
26402025-01-13T09:44:39.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56049
26412025-01-13T09:44:39.410ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26422025-01-13T09:44:39.410ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2
26432025-01-13T09:44:39.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 455 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56049 req_id = 81fee7b6-e4a7-434b-8190-beafbf650001 response_code = 200 uri = /vpc-routes
26442025-01-13T09:44:39.443ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26452025-01-13T09:44:39.443ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c
26462025-01-13T09:44:39.457ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26472025-01-13T09:44:39.458ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22bc846d-e6cf-469c-acea-15b83ef27270
26482025-01-13T09:44:39.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
26492025-01-13T09:44:39.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 710 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56049 req_id = a7ead8ce-42b3-427e-97cf-ce06c0d780d1 response_code = 204 uri = /eip-gateways
26502025-01-13T09:44:39.480ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26512025-01-13T09:44:39.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2
26522025-01-13T09:44:39.495ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26532025-01-13T09:44:39.495ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2
26542025-01-13T09:44:39.520ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26552025-01-13T09:44:39.520ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c
26562025-01-13T09:44:39.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39422
26572025-01-13T09:44:39.525ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26582025-01-13T09:44:39.525ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26592025-01-13T09:44:39.525ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26602025-01-13T09:44:39.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26612025-01-13T09:44:39.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26622025-01-13T09:44:39.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26632025-01-13T09:44:39.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26642025-01-13T09:44:39.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 677 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39422 req_id = ceeff8e4-8603-47cd-bc76-04f7d46f5573 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26652025-01-13T09:44:39.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48956
26662025-01-13T09:44:39.533ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26672025-01-13T09:44:39.533ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd
26682025-01-13T09:44:39.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26692025-01-13T09:44:39.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26702025-01-13T09:44:39.547ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/config/omicron-zones.json file = common/src/ledger.rs:177
26712025-01-13T09:44:39.548ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/config/omicron-zones.json file = common/src/ledger.rs:177
26722025-01-13T09:44:39.551ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26732025-01-13T09:44:39.552ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2
26742025-01-13T09:44:39.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60252
26752025-01-13T09:44:39.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60252 req_id = 5680b249-1d09-4ccd-8aa3-7ef5ac2fc6b5 response_code = 200 uri = /v2p
26762025-01-13T09:44:39.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 847 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56049 req_id = 8afe5e95-329a-4f01-a0ef-14a641671202 response_code = 204 uri = /vpc-routes
26772025-01-13T09:44:39.571ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2de71e7a-7aa7-40aa-94b2-f5938ec32605 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26782025-01-13T09:44:39.571ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2de71e7a-7aa7-40aa-94b2-f5938ec32605
26792025-01-13T09:44:39.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60770
26802025-01-13T09:44:39.576ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26812025-01-13T09:44:39.586ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26822025-01-13T09:44:39.586ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4
26832025-01-13T09:44:39.603ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26842025-01-13T09:44:39.603ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd
26852025-01-13T09:44:39.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369389 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48537 req_id = 9ed30a14-9fb5-4730-b05a-6568c10a8386 response_code = 200 uri = /inventory
26862025-01-13T09:44:39.619ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 27b87a96-9e7b-4bc6-ad58-78fc91134b98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26872025-01-13T09:44:39.619ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_27b87a96-9e7b-4bc6-ad58-78fc91134b98
26882025-01-13T09:44:39.623ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26892025-01-13T09:44:39.648ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64d4fabf-8bb2-428c-9a00-9f83729c832c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26902025-01-13T09:44:39.648ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_64d4fabf-8bb2-428c-9a00-9f83729c832c
26912025-01-13T09:44:39.664ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26922025-01-13T09:44:39.664ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4
26932025-01-13T09:44:39.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367474 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40133 req_id = f6bda262-8d23-4020-bf90-38f4b67687a2 response_code = 200 uri = /inventory
26942025-01-13T09:44:39.687ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22bc846d-e6cf-469c-acea-15b83ef27270 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26952025-01-13T09:44:39.687ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22bc846d-e6cf-469c-acea-15b83ef27270
26962025-01-13T09:44:39.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121303 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60770 req_id = 2ef2cc4f-c79c-4f74-a094-3315bcaf76f7 response_code = 204 uri = /switch-ports
26972025-01-13T09:44:39.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60770 req_id = 53517c39-cae3-470e-b79a-2648d1747138 response_code = 200 uri = /network-bootstore-config
26982025-01-13T09:44:39.716ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 061dfe5d-656e-4f67-9d9c-cbea70f97fc2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26992025-01-13T09:44:39.716ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_061dfe5d-656e-4f67-9d9c-cbea70f97fc2
27002025-01-13T09:44:39.741ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27012025-01-13T09:44:39.741ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c
27022025-01-13T09:44:39.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35658
27032025-01-13T09:44:39.751ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 61b87dec-92bd-4653-aa3d-67786cf48d60, kind: Service { id: ada928be-2ae2-46f2-a73d-9a9db5f21861 }, name: Name("external-dns-ada928be-2ae2-46f2-a73d-9a9db5f21861"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1c94bb7-e310-4c19-bd92-591f4a91f94a, kind: Service { id: 9c3f4527-02c9-47ef-aeb2-b0bfd626d594 }, name: Name("external-dns-9c3f4527-02c9-47ef-aeb2-b0bfd626d594"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3154a120-bdb1-46ba-98bd-0a7547937dd6, kind: Service { id: 75030227-4feb-42d6-8a03-eae109062efd }, name: Name("nexus-75030227-4feb-42d6-8a03-eae109062efd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 35ac5316-1d08-4068-8950-3b9e59a0da6c, kind: Service { id: 39dbc0c2-8038-4a1e-b725-22e9ee3526af }, name: Name("nexus-39dbc0c2-8038-4a1e-b725-22e9ee3526af"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbe4c5cc-aaaa-4439-a778-ef9746ed5671, kind: Service { id: ea5546c0-b69d-4baf-9b69-c722e52b8f80 }, name: Name("nexus-ea5546c0-b69d-4baf-9b69-c722e52b8f80"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27042025-01-13T09:44:39.751ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27052025-01-13T09:44:39.751ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27062025-01-13T09:44:39.751ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27072025-01-13T09:44:39.751ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27082025-01-13T09:44:39.751ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27092025-01-13T09:44:39.751ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27102025-01-13T09:44:39.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35658 req_id = ea58f301-c1b8-49e3-8ab5-b5d66272ef25 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27112025-01-13T09:44:39.769ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e21145b8-25ae-43c6-b0b3-c2fd1e6614b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27122025-01-13T09:44:39.769ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e21145b8-25ae-43c6-b0b3-c2fd1e6614b2
27132025-01-13T09:44:39.795ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e53aeaaa-d279-46ad-a097-730b3fd5d5fd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27142025-01-13T09:44:39.795ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e53aeaaa-d279-46ad-a097-730b3fd5d5fd
27152025-01-13T09:44:39.818ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44f9eaad-b46b-4e93-8913-d5d8e29da6a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27162025-01-13T09:44:39.818ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44f9eaad-b46b-4e93-8913-d5d8e29da6a4
27172025-01-13T09:44:39.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300395 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48956 req_id = 53761b12-dd4a-448d-a176-2233195e3c98 response_code = 200 uri = /inventory
27182025-01-13T09:44:49.022ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7214 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 74a6c640-9e4d-41ad-b77a-fd66560d77c0 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
27192025-01-13T09:44:49.824ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65079
27202025-01-13T09:44:49.825ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65079 req_id = c2ae33e9-f767-44f3-98c1-d5595acdebfd response_code = 200 uri = /baseboard
27212025-01-13T09:45:08.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40691
27222025-01-13T09:45:08.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40691 req_id = 0dc99b87-ec0f-4e96-94c4-491289693f84 response_code = 200 uri = /vpc-routes
27232025-01-13T09:45:08.587ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
27242025-01-13T09:45:08.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40691 req_id = e9c8e37a-4d2e-44a6-a0fb-3c8b2c391735 response_code = 204 uri = /eip-gateways
27252025-01-13T09:45:08.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40691 req_id = fedbffb2-64cc-46cc-adb5-887f458eec96 response_code = 204 uri = /vpc-routes
27262025-01-13T09:45:08.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50997
27272025-01-13T09:45:08.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50997 req_id = 501134a9-994f-4900-bc88-03ff64c8e64f response_code = 200 uri = /vpc-routes
27282025-01-13T09:45:08.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56831
27292025-01-13T09:45:08.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56831 req_id = 2c25f050-d58a-4f2f-a3c6-3705b22a55f3 response_code = 200 uri = /v2p
27302025-01-13T09:45:08.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
27312025-01-13T09:45:08.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50997 req_id = 740d1839-7ac2-48fc-9c25-0dcadcdb2ad8 response_code = 204 uri = /eip-gateways
27322025-01-13T09:45:08.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33096
27332025-01-13T09:45:08.780ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27342025-01-13T09:45:08.822ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27352025-01-13T09:45:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131773 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33096 req_id = ecd03b34-ed93-4d8b-b46b-c986d4e49a45 response_code = 204 uri = /switch-ports
27362025-01-13T09:45:08.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38351
27372025-01-13T09:45:08.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36096
27382025-01-13T09:45:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50997 req_id = 0fdb18b7-4b56-40c6-864d-e031503fba24 response_code = 204 uri = /vpc-routes
27392025-01-13T09:45:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33096 req_id = 65ac019c-6ea4-4fa1-882d-fdedb4d1cd33 response_code = 200 uri = /network-bootstore-config
27402025-01-13T09:45:08.913ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27412025-01-13T09:45:08.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38351 req_id = 3e30745e-5d70-4d34-bd89-a90fbb38aba1 response_code = 200 uri = /v2p
27422025-01-13T09:45:08.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27432025-01-13T09:45:09.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35505
27442025-01-13T09:45:09.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35505 req_id = 8cfc9dd7-a20b-412c-939d-aedcb61b6c92 response_code = 200 uri = /vpc-routes
27452025-01-13T09:45:09.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99031 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36096 req_id = e6fee672-6d59-4961-9be4-e8fe9be3b689 response_code = 204 uri = /switch-ports
27462025-01-13T09:45:09.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36096 req_id = 52e3c2b8-1ed5-48b1-9590-e0969856eb70 response_code = 200 uri = /network-bootstore-config
27472025-01-13T09:45:09.046ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
27482025-01-13T09:45:09.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35505 req_id = 94ac5598-cde6-468c-bb30-e365e1ea45c6 response_code = 204 uri = /eip-gateways
27492025-01-13T09:45:09.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35505 req_id = 24bdff51-43b5-44c6-b300-e1bf744255b6 response_code = 204 uri = /vpc-routes
27502025-01-13T09:45:09.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44594
27512025-01-13T09:45:09.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44594 req_id = 03ed0d88-9953-4808-b19f-1d3fbad9c7de response_code = 200 uri = /v2p
27522025-01-13T09:45:09.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39139
27532025-01-13T09:45:09.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27542025-01-13T09:45:09.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27552025-01-13T09:45:09.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39139 req_id = b4a6fa45-c60d-42d6-a9c0-67d3847f89df response_code = 204 uri = /switch-ports
27562025-01-13T09:45:09.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39139 req_id = 8f7a2030-4ec4-48ed-a775-ef3b10aa83a8 response_code = 200 uri = /network-bootstore-config
27572025-01-13T09:45:19.023ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8112 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 37300303-b8d2-4d13-8fad-10c28e5632b3 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
27582025-01-13T09:45:19.856ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33382
27592025-01-13T09:45:19.856ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33382 req_id = 92a2965c-7050-4be4-9484-a3ed3dfba509 response_code = 200 uri = /baseboard
27602025-01-13T09:45:38.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63074
27612025-01-13T09:45:38.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63074 req_id = 003ab1f2-8f86-4601-81a6-ba396a4a6402 response_code = 200 uri = /vpc-routes
27622025-01-13T09:45:38.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
27632025-01-13T09:45:38.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63074 req_id = a7da4b97-1d65-4c19-9939-f0a89948d49c response_code = 204 uri = /eip-gateways
27642025-01-13T09:45:38.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63074 req_id = 67d44c57-a323-4083-bb67-7b71d59cc67c response_code = 204 uri = /vpc-routes
27652025-01-13T09:45:38.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54731
27662025-01-13T09:45:38.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54731 req_id = 3602c310-bb97-4761-994c-140941d66da6 response_code = 200 uri = /vpc-routes
27672025-01-13T09:45:38.833ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
27682025-01-13T09:45:38.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54731 req_id = 80312da4-a49e-4e5e-a2a0-9dd252e764b9 response_code = 204 uri = /eip-gateways
27692025-01-13T09:45:38.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54731 req_id = 87d300fc-e3e8-4ef3-9280-4d7f8e9c9538 response_code = 204 uri = /vpc-routes
27702025-01-13T09:45:38.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41556
27712025-01-13T09:45:38.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41556 req_id = 6c9afd5f-7646-4cef-b6e4-17ae3f2bfe95 response_code = 200 uri = /v2p
27722025-01-13T09:45:38.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65351
27732025-01-13T09:45:38.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27742025-01-13T09:45:38.989ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27752025-01-13T09:45:39.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116855 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65351 req_id = 6030b9e4-81f7-471c-b380-e4453fa8fadc response_code = 204 uri = /switch-ports
27762025-01-13T09:45:39.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46191
27772025-01-13T09:45:39.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46191 req_id = 3a0f1ea9-4f35-4f9f-b97c-515e4fb8373b response_code = 200 uri = /v2p
27782025-01-13T09:45:39.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65351 req_id = debd8ada-e942-42db-83de-d85828403318 response_code = 200 uri = /network-bootstore-config
27792025-01-13T09:45:39.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50594
27802025-01-13T09:45:39.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50594 req_id = 1d877a1a-6ce6-40ff-8be3-2d0dd2bb2132 response_code = 200 uri = /vpc-routes
27812025-01-13T09:45:39.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41387
27822025-01-13T09:45:39.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27832025-01-13T09:45:39.178ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27842025-01-13T09:45:39.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41387 req_id = 06665a69-a115-4b1c-ab7c-e40abf3971cb response_code = 204 uri = /switch-ports
27852025-01-13T09:45:39.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53630
27862025-01-13T09:45:39.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41387 req_id = 6259f6bc-4a44-4fe7-b3f4-f5c91bb626c6 response_code = 200 uri = /network-bootstore-config
27872025-01-13T09:45:39.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 579 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53630 req_id = 65b6d8eb-34b3-4c58-bef6-2b013f84a655 response_code = 200 uri = /v2p
27882025-01-13T09:45:39.257ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
27892025-01-13T09:45:39.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50594 req_id = 580adb2e-b302-447c-b9ab-12cd44c32c19 response_code = 204 uri = /eip-gateways
27902025-01-13T09:45:39.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50594 req_id = 3b21e543-796f-4d8d-8166-39d06f0c1ea8 response_code = 204 uri = /vpc-routes
27912025-01-13T09:45:39.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58383
27922025-01-13T09:45:39.458ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27932025-01-13T09:45:39.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27942025-01-13T09:45:39.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93979 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58383 req_id = 3d41c4b9-142b-483d-8515-b5512b8cd7a3 response_code = 204 uri = /switch-ports
27952025-01-13T09:45:39.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58383 req_id = 6ad06836-91d3-465d-877a-d96d25498674 response_code = 200 uri = /network-bootstore-config
27962025-01-13T09:45:49.023ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8265 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 72291b29-620b-4235-89d5-b9f74c1c9090 response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
27972025-01-13T09:45:49.888ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55020
27982025-01-13T09:45:49.888ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55020 req_id = 8f9d7433-4a39-44af-adae-a5a25b91b37b response_code = 200 uri = /baseboard
27992025-01-13T09:46:08.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49352
28002025-01-13T09:46:08.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49352 req_id = 214cdfeb-b60d-44c7-b908-c3eb07eabb4a response_code = 200 uri = /vpc-routes
28012025-01-13T09:46:08.668ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
28022025-01-13T09:46:08.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49352 req_id = 6aa8565d-42d8-40ae-bba0-a395f31395d4 response_code = 204 uri = /eip-gateways
28032025-01-13T09:46:08.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34419
28042025-01-13T09:46:08.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34419 req_id = 54023a9a-b8c6-4b4e-a937-a8b778f95f78 response_code = 200 uri = /v2p
28052025-01-13T09:46:08.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46700
28062025-01-13T09:46:08.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46700 req_id = f4d81fc8-3b07-47b4-b57f-0ea62129f08f response_code = 200 uri = /vpc-routes
28072025-01-13T09:46:08.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49352 req_id = bd45bfda-bf48-470c-bc46-fee95ec95135 response_code = 204 uri = /vpc-routes
28082025-01-13T09:46:08.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
28092025-01-13T09:46:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46700 req_id = 42a7670b-71b0-4c97-8540-a776df6a6428 response_code = 204 uri = /eip-gateways
28102025-01-13T09:46:08.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49805
28112025-01-13T09:46:08.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28122025-01-13T09:46:08.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28132025-01-13T09:46:08.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49805 req_id = 37da3ec7-bd0f-4662-ad15-07fbca0e9d1a response_code = 204 uri = /switch-ports
28142025-01-13T09:46:08.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57770
28152025-01-13T09:46:08.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50945
28162025-01-13T09:46:08.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28172025-01-13T09:46:08.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49805 req_id = 76b254b5-d169-4bc5-8b39-90106477d5d8 response_code = 200 uri = /network-bootstore-config
28182025-01-13T09:46:08.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5731 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46700 req_id = ea6322a0-1612-45b0-9de2-186dd98905f7 response_code = 204 uri = /vpc-routes
28192025-01-13T09:46:08.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5626 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50945 req_id = addb6fb0-2c23-4c14-a6e3-d65754d556f3 response_code = 200 uri = /v2p
28202025-01-13T09:46:08.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28212025-01-13T09:46:08.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57770 req_id = d1f118ca-819e-4c41-adfd-fdef0604b652 response_code = 204 uri = /switch-ports
28222025-01-13T09:46:08.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57770 req_id = 398be47a-6fd5-4141-8f7f-511c15b06ec4 response_code = 200 uri = /network-bootstore-config
28232025-01-13T09:46:09.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65420
28242025-01-13T09:46:09.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65420 req_id = 97f30e6c-06ac-474c-94d2-18f4eb4f6b5d response_code = 200 uri = /vpc-routes
28252025-01-13T09:46:09.104ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
28262025-01-13T09:46:09.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65420 req_id = c30b2f86-6c93-454c-9ca8-73b71ce1b945 response_code = 204 uri = /eip-gateways
28272025-01-13T09:46:09.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65420 req_id = 474c9f3c-c2e9-4461-8832-c0f272670369 response_code = 204 uri = /vpc-routes
28282025-01-13T09:46:09.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48294
28292025-01-13T09:46:09.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28302025-01-13T09:46:09.207ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28312025-01-13T09:46:09.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48294 req_id = 8cd8cd82-56ae-49fe-9900-208d26df65a9 response_code = 204 uri = /switch-ports
28322025-01-13T09:46:09.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42058
28332025-01-13T09:46:09.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42058 req_id = cf1e53c2-19cb-4515-abf4-043f37211849 response_code = 200 uri = /v2p
28342025-01-13T09:46:09.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48294 req_id = 61164814-d828-4be8-a28e-de76f956e53f response_code = 200 uri = /network-bootstore-config
28352025-01-13T09:46:12.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61018
28362025-01-13T09:46:12.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61018 req_id = d460e6e4-43df-4a9f-9e32-7fa38d61272c response_code = 200 uri = /v2p
28372025-01-13T09:46:12.151ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4196090) }
28382025-01-13T09:46:12.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61018 req_id = ad294b55-6d63-4491-802f-0858c744f9c3 response_code = 204 uri = /v2p
28392025-01-13T09:46:12.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48939
28402025-01-13T09:46:12.250ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4196090))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 8d0f06bc-5fb6-4c63-8609-6e2a29e202fd, slot: 0, read_only: false, vcr_json: .., name: "disk-1da4474d5c4" }], boot_settings: Some(InstanceBootSettings { order: [8d0f06bc-5fb6-4c63-8609-6e2a29e202fd] }), cloud_init_bytes: Some(..) } instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e metadata = InstanceMetadata { silo_id: 908515bb-b293-4962-9f01-6fe4d1129c5d, project_id: bc8c1eda-6dd7-4c06-892f-eea0c47fdb4a } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-13T09:46:12.243774692Z }
28412025-01-13T09:46:12.250ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e migration_id = None propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28422025-01-13T09:46:12.250ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e migration_id = None propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4196090))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c239e405-fb2d-45e9-aa12-8163c2a88472, kind: Instance { id: 4f6cd95d-1585-4363-8d47-e0186a3c794e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4196090), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 8d0f06bc-5fb6-4c63-8609-6e2a29e202fd, slot: 0, read_only: false, vcr_json: .., name: "disk-1da4474d5c4" }], boot_settings: Some(InstanceBootSettings { order: [8d0f06bc-5fb6-4c63-8609-6e2a29e202fd] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-13T09:46:12.243774692Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28432025-01-13T09:46:12.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9912 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48939 req_id = fe3a22fe-77b3-4018-8bb1-47791a4aec22 response_code = 200 uri = /vmms/2fc3c013-b4c9-4d94-b424-46a822e5b26e
28442025-01-13T09:46:12.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39759
28452025-01-13T09:46:12.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39759 req_id = f13010a9-5172-447e-a1c8-16f3652866e6 response_code = 200 uri = /vmms/2fc3c013-b4c9-4d94-b424-46a822e5b26e/state
28462025-01-13T09:46:12.342ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4196090 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28472025-01-13T09:46:12.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28482025-01-13T09:46:12.381ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e file = illumos-utils/src/zone.rs:325 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28492025-01-13T09:46:12.404ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e file = illumos-utils/src/zone.rs:363 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28502025-01-13T09:46:12.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38889
28512025-01-13T09:46:12.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38889 req_id = 5003355b-c8c4-4dd2-ba12-973a1148e9e6 response_code = 200 uri = /vpc-routes
28522025-01-13T09:46:12.432ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {c239e405-fb2d-45e9-aa12-8163c2a88472: {10.151.2.176: {cb0971ad-ae8e-4bc7-a8c3-4fd82c54a2b7}, 10.151.2.175: {cb0971ad-ae8e-4bc7-a8c3-4fd82c54a2b7}}} }
28532025-01-13T09:46:14.152ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28542025-01-13T09:46:14.152ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e zone file = illumos-utils/src/running_zone.rs:488 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28552025-01-13T09:46:14.333ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 61.853846ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28562025-01-13T09:46:14.415ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 144.89711ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28572025-01-13T09:46:14.578ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 217.229426ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28582025-01-13T09:46:14.812ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 488.144875ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28592025-01-13T09:46:15.315ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 410.259177ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28602025-01-13T09:46:15.736ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 1.18967578s file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28612025-01-13T09:46:16.937ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 1.399319796s file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28622025-01-13T09:46:18.347ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 997.223746ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e zone = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28632025-01-13T09:46:19.022ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6947 local_addr = [fd00:1122:3344:101::1]:51883 method = GET remote_addr = [fd00:1122:3344:101::d]:38427 req_id = 714ee43e-0598-4449-be50-595ee5da3f9d response_code = 200 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 uri = /23b0ec58-d6f5-4744-a480-2ff78825ad63
28642025-01-13T09:46:19.374ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e file = sled-agent/src/instance.rs:2067 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28652025-01-13T09:46:19.384ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 26.483517ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28662025-01-13T09:46:19.422ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 115.961542ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28672025-01-13T09:46:19.547ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e") failed: Property not found. retry in 279.486292ms file = illumos-utils/src/svc.rs:36 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28682025-01-13T09:46:19.837ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28692025-01-13T09:46:19.874ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28702025-01-13T09:46:19.919ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60672
28712025-01-13T09:46:19.920ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60672 req_id = 439c11d4-7543-4ca0-b9ce-e33d6c65fd5b response_code = 200 uri = /baseboard
28722025-01-13T09:46:20.017ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28732025-01-13T09:46:20.017ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
28742025-01-13T09:46:20.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7585843 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38889 req_id = 57538b3f-d89b-4111-8cb1-fd1a20fcf0f8 response_code = 204 uri = /eip-gateways
28752025-01-13T09:46:20.017ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-13T09:46:20.017842383Z } file = sled-agent/src/instance.rs:780 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28762025-01-13T09:46:20.017ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-13T09:46:20.017842383Z } propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28772025-01-13T09:46:20.017ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-13T09:46:20.017842383Z }, migration_in: None, migration_out: None }
28782025-01-13T09:46:20.059ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-13T09:46:20.059032151Z } file = sled-agent/src/instance.rs:780 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28792025-01-13T09:46:20.059ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-13T09:46:20.059032151Z } propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28802025-01-13T09:46:20.059ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-13T09:46:20.059032151Z }, migration_in: None, migration_out: None }
28812025-01-13T09:46:20.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38889 req_id = 2bfa3af9-b3fa-4957-9984-f61ed3ce8e78 response_code = 204 uri = /vpc-routes
28822025-01-13T09:46:29.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56048
28832025-01-13T09:46:29.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 480 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56048 req_id = 850c966f-4e03-4ef2-89df-6e49b4246824 response_code = 200 uri = /vmms/2fc3c013-b4c9-4d94-b424-46a822e5b26e/state
28842025-01-13T09:46:29.849ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-13T09:46:29.849717977Z } file = sled-agent/src/instance.rs:780 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28852025-01-13T09:46:29.849ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-13T09:46:29.849717977Z } propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28862025-01-13T09:46:29.849ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-13T09:46:29.849717977Z }, migration_in: None, migration_out: None }
28872025-01-13T09:46:29.888ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-13T09:46:29.888781275Z } file = sled-agent/src/instance.rs:780 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28882025-01-13T09:46:29.888ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-13T09:46:29.888781275Z } propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28892025-01-13T09:46:29.888ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28902025-01-13T09:46:29.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28912025-01-13T09:46:29.888ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7384691335516145378 n_samples = 6 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
28922025-01-13T09:46:29.888ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11478438508192951686 n_samples = 6 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
28932025-01-13T09:46:29.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28942025-01-13T09:46:29.889ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/4296f26d-263a-457b-8da9-fc9ac9718289/debug/bundle/zone", "/pool/int/abb1fad1-12b8-4ada-86f9-9b719a4f6748/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/2de71e7a-7aa7-40aa-94b2-f5938ec32605/crypt/debug", "/pool/ext/27b87a96-9e7b-4bc6-ad58-78fc91134b98/crypt/debug", "/pool/ext/64d4fabf-8bb2-428c-9a00-9f83729c832c/crypt/debug", "/pool/ext/22bc846d-e6cf-469c-acea-15b83ef27270/crypt/debug", "/pool/ext/061dfe5d-656e-4f67-9d9c-cbea70f97fc2/crypt/debug", "/pool/ext/c7b5e3e1-9b33-43e9-aee9-fd4e0d3ce58c/crypt/debug", "/pool/ext/e21145b8-25ae-43c6-b0b3-c2fd1e6614b2/crypt/debug", "/pool/ext/e53aeaaa-d279-46ad-a097-730b3fd5d5fd/crypt/debug", "/pool/ext/44f9eaad-b46b-4e93-8913-d5d8e29da6a4/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e
28952025-01-13T09:46:30.516ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e", bundle_id: db6ceb8d-8caa-4b0a-8b06-3116a16d405f }, time_created: 2025-01-13T09:46:29.889511536Z, version: 0, cause: TerminatedInstance }
28962025-01-13T09:46:30.516ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_2fc3c013-b4c9-4d94-b424-46a822e5b26e file = sled-agent/src/instance.rs:1313 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28972025-01-13T09:46:32.292ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
28982025-01-13T09:46:32.309ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4196090), kind: System }
28992025-01-13T09:46:32.309ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4196090), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29002025-01-13T09:46:32.309ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-13T09:46:32.309896883Z }, migration_in: None, migration_out: None }
29012025-01-13T09:46:32.333ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-13T09:46:32.309896883Z }, migration_in: None, migration_out: None }
29022025-01-13T09:46:32.337ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 4f6cd95d-1585-4363-8d47-e0186a3c794e propolis_id = 2fc3c013-b4c9-4d94-b424-46a822e5b26e
29032025-01-13T09:46:32.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61659
29042025-01-13T09:46:32.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61659 req_id = 2cecacc4-b660-464e-8a86-be42c634c32e response_code = 200 uri = /vpc-routes
29052025-01-13T09:46:32.708ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {c239e405-fb2d-45e9-aa12-8163c2a88472: {10.151.2.175: {cb0971ad-ae8e-4bc7-a8c3-4fd82c54a2b7}, 10.151.2.176: {cb0971ad-ae8e-4bc7-a8c3-4fd82c54a2b7}}} }
29062025-01-13T09:46:32.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61659 req_id = f5b26746-2660-403b-960c-7eea3d7a4863 response_code = 204 uri = /eip-gateways
29072025-01-13T09:46:32.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42937
29082025-01-13T09:46:32.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42937 req_id = 46f6dee6-42b5-477f-a2a5-8b0a776e75ab response_code = 200 uri = /v2p
29092025-01-13T09:46:32.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61659 req_id = 87b7d3cd-a57f-4853-b100-70570f52873d response_code = 204 uri = /vpc-routes
29102025-01-13T09:46:32.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51060
29112025-01-13T09:46:32.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51060 req_id = 5456eb13-ea49-403d-97ec-749c82a41b84 response_code = 200 uri = /v2p
29122025-01-13T09:46:33.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42002
29132025-01-13T09:46:33.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42002 req_id = 834229b0-54f2-4bce-9c61-019c71302097 response_code = 200 uri = /vpc-routes
29142025-01-13T09:46:33.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
29152025-01-13T09:46:33.137ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63
29162025-01-13T09:46:33.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42002 req_id = 6055b083-31f4-4430-b245-1d035c89ac41 response_code = 204 uri = /eip-gateways
29172025-01-13T09:46:33.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42002 req_id = 37c18ad5-c9e6-42ef-8a06-b0fb1b8c4cea response_code = 204 uri = /vpc-routes
29182025-01-13T09:46:33.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42046
29192025-01-13T09:46:33.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42046 req_id = 6c3f41f7-8a12-4313-ac6b-a29ff2b70666 response_code = 200 uri = /vpc-routes
29202025-01-13T09:46:33.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 23b0ec58-d6f5-4744-a480-2ff78825ad63 values = ExternalIpGatewayMap { mappings: {} }
29212025-01-13T09:46:33.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42046 req_id = f6b8e3c8-91f8-4805-9ac9-b92af137ff52 response_code = 204 uri = /eip-gateways
29222025-01-13T09:46:33.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42046 req_id = 63704e79-7531-45d8-a6a2-208147ca2d18 response_code = 204 uri = /vpc-routes