Max level shown:
1 [ Nov 6 23:57:32 Enabled. ]
2 [ Nov 6 23:57:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 6 23:57:32 Method "start" exited with status 0. ]
4 [ Nov 6 23:57:32 Rereading configuration. ]
5 [ Nov 6 23:57:32 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-06T23:57:32.752ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-06T23:57:32.753ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-06T23:57:32.803ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-06T23:57:32.803ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-06T23:57:32.918ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-06T23:57:32.926ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-06T23:57:32.934ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-06T23:57:33.534ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-06T23:57:33.670ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-06T23:57:33.670ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-06T23:57:33.670ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-06T23:57:33.670ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-06T23:57:33.670ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-11-06T23:57:33.670ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-11-06T23:57:33.673ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-06T23:57:33.673ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-06T23:57:33.673ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-06T23:57:33.673ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-06T23:57:33.673ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-06T23:57:33.673ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-06T23:57:33.673ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-11-06T23:57:33.673ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-06T23:57:33.673ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-06T23:57:33.684ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-06T23:57:33.684ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 4570c3a5-1712-4889-a368-30df2852f980 (zpool)
322024-11-06T23:57:33.781ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal }
332024-11-06T23:57:34.245ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-11-06T23:57:34.246ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-06T23:57:34.246ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-06T23:57:34.246ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-06T23:57:34.246ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-11-06T23:57:34.246ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-06T23:57:34.246ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-06T23:57:34.254ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-06T23:57:34.254ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool)
422024-11-06T23:57:34.343ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal }
432024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
472024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
532024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
572024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
642024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
662024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
722024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
782024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
812024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
852024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
872024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-06T23:57:34.814ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
932024-11-06T23:57:34.814ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-06T23:57:34.814ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-06T23:57:34.814ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-06T23:57:34.814ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-06T23:57:34.814ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-06T23:57:34.814ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1002024-11-06T23:57:34.815ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-11-06T23:57:34.815ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-06T23:57:34.815ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-06T23:57:34.815ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-06T23:57:34.815ZINFOSledAgent (bootstore): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-06T23:57:34.815ZINFOSledAgent (bootstore): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-06T23:57:34.815ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-06T23:57:34.815ZINFOSledAgent (bootstore): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-06T23:57:34.815ZINFOSledAgent (bootstore): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-06T23:57:34.815ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-06T23:57:34.815ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-06T23:57:34.815ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-06T23:57:34.825ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1132024-11-06T23:57:34.825ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3573, tv_nsec: 271631536 } time_to_next_cleanup = 599.999928058s
1142024-11-06T23:57:34.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1152024-11-06T23:57:34.825ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3910
1162024-11-06T23:57:34.825ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-06T23:57:34.825ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-06T23:57:34.828ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-06T23:57:34.830ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-06T23:57:34.831ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1083
1212024-11-06T23:57:34.831ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-06T23:57:34.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-11-06T23:57:34.831ZINFOSledAgent (RSS): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-06T23:57:34.831ZINFOSledAgent (RSS): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-06T23:57:34.831ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1146
1262024-11-06T23:57:34.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-11-06T23:57:34.831ZINFOSledAgent (RSS): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-06T23:57:34.831ZINFOSledAgent (RSS): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-06T23:57:34.831ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1188
1302024-11-06T23:57:34.831ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-06T23:57:34.831ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-06T23:57:34.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-11-06T23:57:34.831ZINFOSledAgent (RSS): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-06T23:57:34.831ZINFOSledAgent (RSS): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-06T23:57:34.831ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 89bb4072-177e-4b94-98e6-7ed6416e7431, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 69a45541-8490-420b-8636-983c871692fd (sled), rack_id: 89bb4072-177e-4b94-98e6-7ed6416e7431, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-06T23:57:34.831ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1222
1372024-11-06T23:57:34.831ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-06T23:57:34.831ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-06T23:57:34.831ZINFOSledAgent (bootstore): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-06T23:57:34.832ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-06T23:57:34.832ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 69a45541-8490-420b-8636-983c871692fd (sled), rack_id: 89bb4072-177e-4b94-98e6-7ed6416e7431, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-06T23:57:34.832ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4207
1432024-11-06T23:57:34.832ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4589
1442024-11-06T23:57:34.836ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-06T23:57:34.842ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-06T23:57:34.842ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-06T23:57:34.848ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-06T23:57:34.848ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-06T23:57:34.848ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:65054
1502024-11-06T23:57:34.849ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 69a45541-8490-420b-8636-983c871692fd (sled), rack_id: 89bb4072-177e-4b94-98e6-7ed6416e7431, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-06T23:57:34.849ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-06T23:57:34.849ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-06T23:57:34.849ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1552024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1562024-11-06T23:57:34.849ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1602024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1612024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1622024-11-06T23:57:34.849ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-06T23:57:34.849ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1642024-11-06T23:57:34.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1652024-11-06T23:57:34.880ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-06T23:57:34.896ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-06T23:57:34.908ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 69a45541-8490-420b-8636-983c871692fd
1682024-11-06T23:57:34.909ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1692024-11-06T23:57:34.909ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 69a45541-8490-420b-8636-983c871692fd
1702024-11-06T23:57:34.909ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-06T23:57:34.911ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 121.326663ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "921ca9a6-cae4-4314-9e9e-1867460bac31", "content-length": "124", "date": "Wed, 06 Nov 2024 23:57:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "921ca9a6-cae4-4314-9e9e-1867460bac31" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-06T23:57:34.923ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_4570c3a5-1712-4889-a368-30df2852f980/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-06T23:57:34.945ZINFOSledAgent: successfully created encrypted zvol: name="oxi_4570c3a5-1712-4889-a368-30df2852f980/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-06T23:57:34.945ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_4570c3a5-1712-4889-a368-30df2852f980/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-06T23:57:34.950ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 69a45541-8490-420b-8636-983c871692fd
1762024-11-06T23:57:34.950ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-06T23:57:34.950ZINFOSledAgent (BackingFs): Ensuring dataset oxi_4570c3a5-1712-4889-a368-30df2852f980/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-06T23:57:35.031ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792024-11-06T23:57:35.034ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-11-06T23:57:35.034ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 127.604353ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5a70f300-564c-4e62-a362-b82aff08cd17", "content-length": "124", "date": "Wed, 06 Nov 2024 23:57:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5a70f300-564c-4e62-a362-b82aff08cd17" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-11-06T23:57:35.163ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-06T23:57:35.163ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 160.647724ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5ee1b823-f1bf-4e88-94f2-8d37b5a947a4", "content-length": "124", "date": "Wed, 06 Nov 2024 23:57:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5ee1b823-f1bf-4e88-94f2-8d37b5a947a4" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-06T23:57:35.249ZINFOSledAgent (BackingFs): Mounting oxi_4570c3a5-1712-4889-a368-30df2852f980/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-06T23:57:35.263ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-06T23:57:35.263ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-06T23:57:35.263ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-06T23:57:35.263ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-06T23:57:35.325ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-06T23:57:35.325ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 86.943451ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "91b35348-f2ed-4de9-a72f-86f0f40549a7", "content-length": "124", "date": "Wed, 06 Nov 2024 23:57:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "91b35348-f2ed-4de9-a72f-86f0f40549a7" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-06T23:57:35.414ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-06T23:57:35.414ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 200.611427ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0f9ac022-64e6-448d-8936-d2f2dc06cf63", "content-length": "124", "date": "Wed, 06 Nov 2024 23:57:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0f9ac022-64e6-448d-8936-d2f2dc06cf63" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-06T23:57:35.615ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-06T23:57:35.616ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 265.587629ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d0428114-c30e-48ea-8eb8-a03073443448", "content-length": "124", "date": "Wed, 06 Nov 2024 23:57:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d0428114-c30e-48ea-8eb8-a03073443448" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-06T23:57:35.882ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-06T23:57:35.883ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 412.219244ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b6cb8c18-bd1e-43ca-836b-8c366302d217", "content-length": "124", "date": "Wed, 06 Nov 2024 23:57:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b6cb8c18-bd1e-43ca-836b-8c366302d217" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-06T23:57:35.992ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 69a45541-8490-420b-8636-983c871692fd
1972024-11-06T23:57:35.997ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:60942 sled_id = 69a45541-8490-420b-8636-983c871692fd
1982024-11-06T23:57:35.997ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 69a45541-8490-420b-8636-983c871692fd
1992024-11-06T23:57:35.998ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:60942 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 69a45541-8490-420b-8636-983c871692fd sled_id = 69a45541-8490-420b-8636-983c871692fd
2002024-11-06T23:57:35.999ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 307.913539ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 69a45541-8490-420b-8636-983c871692fd
2012024-11-06T23:57:35.999ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 69a45541-8490-420b-8636-983c871692fd
2022024-11-06T23:57:35.999ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 69a45541-8490-420b-8636-983c871692fd
2032024-11-06T23:57:35.999ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2042024-11-06T23:57:35.999ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-06T23:57:36.295ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-06T23:57:36.309ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 570.525547ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 69a45541-8490-420b-8636-983c871692fd
2072024-11-06T23:57:36.882ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 721.9948ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 69a45541-8490-420b-8636-983c871692fd
2082024-11-06T23:57:37.605ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.633998214s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 69a45541-8490-420b-8636-983c871692fd
2092024-11-06T23:57:38.425ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2102024-11-06T23:57:38.425ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2112024-11-06T23:57:38.425ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2122024-11-06T23:57:38.425ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2132024-11-06T23:57:38.425ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2142024-11-06T23:57:38.425ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2152024-11-06T23:57:38.427ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2162024-11-06T23:57:38.428ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2172024-11-06T23:57:38.428ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='7de66e48-c9a8-45f7-a2c4-1cb6e9667e25'/> <propval type="astring" name="rack_id" value='89bb4072-177e-4b94-98e6-7ed6416e7431'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fede:9af6'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='69a45541-8490-420b-8636-983c871692fd'/> <propval type="astring" name="rack_id" value='89bb4072-177e-4b94-98e6-7ed6416e7431'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='69a45541-8490-420b-8636-983c871692fd'/> <propval type="astring" name="rack_uuid" value='89bb4072-177e-4b94-98e6-7ed6416e7431'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='69a45541-8490-420b-8636-983c871692fd'/> <propval type="astring" name="rack_uuid" value='89bb4072-177e-4b94-98e6-7ed6416e7431'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-06T23:57:38.429ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-06T23:57:38.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 73.07684ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-06T23:57:38.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 94.101417ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-06T23:57:39.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 222.716795ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-06T23:57:39.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 448.177663ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-06T23:57:40.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 797.623216ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-06T23:57:40.242ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.804175925s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 69a45541-8490-420b-8636-983c871692fd
2252024-11-06T23:57:41.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 788.825723ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-06T23:57:41.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 928.335959ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-06T23:57:43.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 689.594764ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-06T23:57:43.131ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.061415529s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 69a45541-8490-420b-8636-983c871692fd
2292024-11-06T23:57:44.358ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/69a45541-8490-420b-8636-983c871692fd) file = sled-agent/src/nexus.rs:527 sled_id = 69a45541-8490-420b-8636-983c871692fd
2302024-11-06T23:57:44.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2312024-11-06T23:57:44.388ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 69a45541-8490-420b-8636-983c871692fd
2322024-11-06T23:57:44.389ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-06T23:57:44.389ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-06T23:57:44.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2352024-11-06T23:57:44.389ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-06T23:57:44.389ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-06T23:57:44.389ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-06T23:57:44.389ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-11-06T23:57:44.389ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3910
2402024-11-06T23:57:44.389ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:65054
2412024-11-06T23:57:44.574ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2422024-11-06T23:57:44.574ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2432024-11-06T23:57:44.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2442024-11-06T23:57:44.575ZINFOSledAgent (RSS): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-06T23:57:44.575ZINFOSledAgent (RSS): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-06T23:57:44.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-11-06T23:57:44.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-11-06T23:57:44.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2492024-11-06T23:57:44.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2502024-11-06T23:57:44.579ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4231 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-06T23:57:44.579ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4247
2522024-11-06T23:57:44.579ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-06T23:57:44.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49023
2542024-11-06T23:57:44.834ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2552024-11-06T23:57:44.834ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2562024-11-06T23:57:44.834ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-06T23:57:44.834ZINFOSledAgent (ServiceManager): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-06T23:57:44.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49023 req_id = 28f8fe6c-2391-4ac9-8996-e3148b53ef89 response_code = 200 uri = /inventory
2592024-11-06T23:57:44.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46852
2602024-11-06T23:57:44.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46852 req_id = 7d68ca4b-8b52-46fd-84f7-7112e24f0cc1 response_code = 200 uri = /sled-role
2612024-11-06T23:57:44.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2622024-11-06T23:57:44.865ZINFOSledAgent (RSS): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-06T23:57:44.865ZINFOSledAgent (RSS): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-06T23:57:44.866ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2652024-11-06T23:57:44.895ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 965bed65-cba9-453f-aade-44d5b0ce7718, pool_id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 2052c875-1d7f-4645-aea3-1df2ff838cd8, pool_id: 737b2345-38a9-43c1-8e04-028013083dab (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a53ea707-4264-4520-8f40-5ca5c5632ac6, pool_id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8e3d0680-0573-402a-a1d9-1d81c85b56eb, pool_id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 40e53489-4b96-4d7b-895d-5e86403796ae, pool_id: b526a174-72fc-4230-a1f2-853297828dee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ea6874fb-f9ad-4141-ba59-ab7b1e0cd7b2, pool_id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 458c97a3-c073-44d4-879a-4b4e81dbd24b, pool_id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d3752fe7-0767-4fda-992f-22fa657221a9, pool_id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5cb0cb3c-c905-4725-b8d6-dc75a3e579bf, pool_id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-06T23:57:44.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41549
2672024-11-06T23:57:44.895ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:886 sled_id = 69a45541-8490-420b-8636-983c871692fd
2682024-11-06T23:57:44.895ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 965bed65-cba9-453f-aade-44d5b0ce7718, pool_id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 2052c875-1d7f-4645-aea3-1df2ff838cd8, pool_id: 737b2345-38a9-43c1-8e04-028013083dab (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a53ea707-4264-4520-8f40-5ca5c5632ac6, pool_id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8e3d0680-0573-402a-a1d9-1d81c85b56eb, pool_id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 40e53489-4b96-4d7b-895d-5e86403796ae, pool_id: b526a174-72fc-4230-a1f2-853297828dee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ea6874fb-f9ad-4141-ba59-ab7b1e0cd7b2, pool_id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 458c97a3-c073-44d4-879a-4b4e81dbd24b, pool_id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d3752fe7-0767-4fda-992f-22fa657221a9, pool_id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5cb0cb3c-c905-4725-b8d6-dc75a3e579bf, pool_id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2692024-11-06T23:57:44.895ZINFOSledAgent (StorageManager): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-06T23:57:44.895ZINFOSledAgent (StorageManager): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-06T23:57:44.895ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2722024-11-06T23:57:44.895ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-06T23:57:44.895ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-06T23:57:44.895ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-06T23:57:44.895ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-06T23:57:45.072ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-11-06T23:57:45.072ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool)
2782024-11-06T23:57:45.519ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/69a45541-8490-420b-8636-983c871692fd) file = sled-agent/src/probe_manager.rs:231 sled_id = 69a45541-8490-420b-8636-983c871692fd
2792024-11-06T23:57:45.974ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 69a45541-8490-420b-8636-983c871692fd
2802024-11-06T23:57:46.002ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2937391394269391503 sled_id = 69a45541-8490-420b-8636-983c871692fd
2812024-11-06T23:57:46.002ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12419165894931887427 sled_id = 69a45541-8490-420b-8636-983c871692fd
2822024-11-06T23:57:46.003ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }
2832024-11-06T23:57:46.012ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:225
2842024-11-06T23:57:46.012ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:227
2852024-11-06T23:57:46.012ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2862024-11-06T23:57:46.012ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:233
2872024-11-06T23:57:46.012ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-06T23:57:46.012ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-06T23:57:46.012ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
2902024-11-06T23:57:46.048ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-11-06T23:57:46.056ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3da17e53-d384-4209-aa7d-1c0e0650f28d/crypt/zone file = sled-storage/src/dataset.rs:288
2922024-11-06T23:57:46.230ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3da17e53-d384-4209-aa7d-1c0e0650f28d file = sled-storage/src/dataset.rs:374
2932024-11-06T23:57:46.239ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2942024-11-06T23:57:46.239ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2952024-11-06T23:57:46.239ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2962024-11-06T23:57:46.239ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-11-06T23:57:46.239ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2982024-11-06T23:57:46.249ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2992024-11-06T23:57:46.249ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 737b2345-38a9-43c1-8e04-028013083dab (zpool)
3002024-11-06T23:57:46.344ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }
3012024-11-06T23:57:46.352ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:225
3022024-11-06T23:57:46.352ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:227
3032024-11-06T23:57:46.352ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
3042024-11-06T23:57:46.352ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:233
3052024-11-06T23:57:46.352ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-06T23:57:46.352ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-06T23:57:46.352ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3082024-11-06T23:57:46.387ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3092024-11-06T23:57:46.395ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_737b2345-38a9-43c1-8e04-028013083dab/crypt/zone file = sled-storage/src/dataset.rs:288
3102024-11-06T23:57:46.521ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/69a45541-8490-420b-8636-983c871692fd) file = sled-agent/src/probe_manager.rs:231 sled_id = 69a45541-8490-420b-8636-983c871692fd
3112024-11-06T23:57:46.568ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_737b2345-38a9-43c1-8e04-028013083dab file = sled-storage/src/dataset.rs:374
3122024-11-06T23:57:46.576ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-06T23:57:46.576ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-06T23:57:46.576ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-06T23:57:46.576ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-06T23:57:46.576ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-06T23:57:46.586ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-06T23:57:46.586ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool)
3192024-11-06T23:57:46.676ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }
3202024-11-06T23:57:46.684ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:225
3212024-11-06T23:57:46.684ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:227
3222024-11-06T23:57:46.684ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3232024-11-06T23:57:46.684ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:233
3242024-11-06T23:57:46.684ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-06T23:57:46.684ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-06T23:57:46.684ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3272024-11-06T23:57:46.718ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-06T23:57:46.726ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_77b9d04f-ff62-4bf6-80b6-1ba59410cf90/crypt/zone file = sled-storage/src/dataset.rs:288
3292024-11-06T23:57:46.897ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_77b9d04f-ff62-4bf6-80b6-1ba59410cf90 file = sled-storage/src/dataset.rs:374
3302024-11-06T23:57:46.905ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-06T23:57:46.905ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-06T23:57:46.905ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-06T23:57:46.905ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-06T23:57:46.905ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-06T23:57:46.914ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-06T23:57:46.914ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool)
3372024-11-06T23:57:47.010ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }
3382024-11-06T23:57:47.018ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:225
3392024-11-06T23:57:47.018ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:227
3402024-11-06T23:57:47.018ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3412024-11-06T23:57:47.018ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:233
3422024-11-06T23:57:47.018ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-06T23:57:47.018ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-06T23:57:47.018ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3452024-11-06T23:57:47.055ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-06T23:57:47.064ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2e9aa741-c339-4c7e-bd6a-302462e9a45d/crypt/zone file = sled-storage/src/dataset.rs:288
3472024-11-06T23:57:47.241ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2e9aa741-c339-4c7e-bd6a-302462e9a45d file = sled-storage/src/dataset.rs:374
3482024-11-06T23:57:47.249ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3492024-11-06T23:57:47.249ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3502024-11-06T23:57:47.249ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3512024-11-06T23:57:47.249ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-11-06T23:57:47.249ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3532024-11-06T23:57:47.259ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3542024-11-06T23:57:47.259ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b526a174-72fc-4230-a1f2-853297828dee (zpool)
3552024-11-06T23:57:47.355ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }
3562024-11-06T23:57:47.363ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:225
3572024-11-06T23:57:47.363ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:227
3582024-11-06T23:57:47.363ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3592024-11-06T23:57:47.363ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:233
3602024-11-06T23:57:47.363ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-06T23:57:47.364ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-06T23:57:47.364ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3632024-11-06T23:57:47.400ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3642024-11-06T23:57:47.409ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b526a174-72fc-4230-a1f2-853297828dee/crypt/zone file = sled-storage/src/dataset.rs:288
3652024-11-06T23:57:47.524ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/69a45541-8490-420b-8636-983c871692fd) file = sled-agent/src/probe_manager.rs:231 sled_id = 69a45541-8490-420b-8636-983c871692fd
3662024-11-06T23:57:47.583ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b526a174-72fc-4230-a1f2-853297828dee file = sled-storage/src/dataset.rs:374
3672024-11-06T23:57:47.591ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-06T23:57:47.591ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-06T23:57:47.591ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-06T23:57:47.591ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-06T23:57:47.591ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-06T23:57:47.601ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-06T23:57:47.601ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool)
3742024-11-06T23:57:47.697ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External }
3752024-11-06T23:57:47.705ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:225
3762024-11-06T23:57:47.705ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:227
3772024-11-06T23:57:47.705ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3782024-11-06T23:57:47.705ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:233
3792024-11-06T23:57:47.705ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-06T23:57:47.705ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-06T23:57:47.705ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3822024-11-06T23:57:47.741ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-06T23:57:47.749ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_21b357d6-ee4d-46ce-a662-7388891b2eb0/crypt/zone file = sled-storage/src/dataset.rs:288
3842024-11-06T23:57:47.924ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_21b357d6-ee4d-46ce-a662-7388891b2eb0 file = sled-storage/src/dataset.rs:374
3852024-11-06T23:57:47.933ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-06T23:57:47.933ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-06T23:57:47.933ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-06T23:57:47.933ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-06T23:57:47.933ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-06T23:57:47.943ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-06T23:57:47.943ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool)
3922024-11-06T23:57:48.038ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External }
3932024-11-06T23:57:48.046ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:225
3942024-11-06T23:57:48.046ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:227
3952024-11-06T23:57:48.046ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
3962024-11-06T23:57:48.047ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:233
3972024-11-06T23:57:48.047ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-06T23:57:48.047ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-06T23:57:48.047ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4002024-11-06T23:57:48.084ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4012024-11-06T23:57:48.093ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_25e5b8a8-6c0f-412b-8992-b44def269af8/crypt/zone file = sled-storage/src/dataset.rs:288
4022024-11-06T23:57:48.266ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_25e5b8a8-6c0f-412b-8992-b44def269af8 file = sled-storage/src/dataset.rs:374
4032024-11-06T23:57:48.274ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4042024-11-06T23:57:48.274ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4052024-11-06T23:57:48.274ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4062024-11-06T23:57:48.274ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4072024-11-06T23:57:48.274ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4082024-11-06T23:57:48.286ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4092024-11-06T23:57:48.286ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ae074693-ac16-4071-b410-16e9a1afa3ad (zpool)
4102024-11-06T23:57:48.385ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool), kind: External }
4112024-11-06T23:57:48.393ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:225
4122024-11-06T23:57:48.393ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:227
4132024-11-06T23:57:48.393ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4142024-11-06T23:57:48.393ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:233
4152024-11-06T23:57:48.393ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-06T23:57:48.393ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-06T23:57:48.393ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4182024-11-06T23:57:48.430ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4192024-11-06T23:57:48.438ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ae074693-ac16-4071-b410-16e9a1afa3ad/crypt/zone file = sled-storage/src/dataset.rs:288
4202024-11-06T23:57:48.528ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/69a45541-8490-420b-8636-983c871692fd) file = sled-agent/src/probe_manager.rs:231 sled_id = 69a45541-8490-420b-8636-983c871692fd
4212024-11-06T23:57:48.611ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ae074693-ac16-4071-b410-16e9a1afa3ad file = sled-storage/src/dataset.rs:374
4222024-11-06T23:57:48.619ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-06T23:57:48.619ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-06T23:57:48.619ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-06T23:57:48.619ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-06T23:57:48.619ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-06T23:57:48.629ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-06T23:57:48.629ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool)
4292024-11-06T23:57:48.753ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool), kind: External }
4302024-11-06T23:57:48.762ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:225
4312024-11-06T23:57:48.762ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:227
4322024-11-06T23:57:48.762ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4332024-11-06T23:57:48.762ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:233
4342024-11-06T23:57:48.762ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-06T23:57:48.762ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-06T23:57:48.762ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4372024-11-06T23:57:48.801ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-06T23:57:48.809ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_aa9b2bf5-6331-4c37-9308-cee886ded211/crypt/zone file = sled-storage/src/dataset.rs:288
4392024-11-06T23:57:48.985ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_aa9b2bf5-6331-4c37-9308-cee886ded211 file = sled-storage/src/dataset.rs:374
4402024-11-06T23:57:48.994ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-06T23:57:48.994ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-06T23:57:48.994ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-06T23:57:48.994ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4570c3a5-1712-4889-a368-30df2852f980 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83bc5ff0-ecb5-4e20-a614-41b76e27f040 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-06T23:57:48.994ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-06T23:57:48.994ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-06T23:57:48.994ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-06T23:57:48.994ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:890 sled_id = 69a45541-8490-420b-8636-983c871692fd
4482024-11-06T23:57:48.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4492024-11-06T23:57:48.994ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:916 generation = Generation(1) sled_id = 69a45541-8490-420b-8636-983c871692fd
4502024-11-06T23:57:48.994ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:921 sled_id = 69a45541-8490-420b-8636-983c871692fd
4512024-11-06T23:57:48.994ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:926 sled_id = 69a45541-8490-420b-8636-983c871692fd
4522024-11-06T23:57:48.994ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 69a45541-8490-420b-8636-983c871692fd
4532024-11-06T23:57:48.994ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:932 sled_id = 69a45541-8490-420b-8636-983c871692fd
4542024-11-06T23:57:48.994ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-06T23:57:48.994ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:937 sled_id = 69a45541-8490-420b-8636-983c871692fd
4562024-11-06T23:57:48.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4099531 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41549 req_id = 0b1ee791-78ff-43f6-b747-ecaba6996242 response_code = 200 uri = /omicron-physical-disks
4572024-11-06T23:57:49.025ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 966c780a-9775-42cd-94b6-1c4592827189 (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3817b532-d8fa-4620-bf75-3656f01b6f41 (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a (service), filesystem_pool: Some(ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-06T23:57:49.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42918
4592024-11-06T23:57:49.026ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4602024-11-06T23:57:49.026ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }
4612024-11-06T23:57:49.074ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4622024-11-06T23:57:49.074ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }
4632024-11-06T23:57:49.125ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4642024-11-06T23:57:49.125ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4652024-11-06T23:57:49.174ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4662024-11-06T23:57:49.174ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:188
4672024-11-06T23:57:49.174ZINFOSledAgent (ServiceManager): No ledger in /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:188
4682024-11-06T23:57:49.174ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4692024-11-06T23:57:49.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4702024-11-06T23:57:49.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4712024-11-06T23:57:49.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4722024-11-06T23:57:49.268ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189 file = illumos-utils/src/zone.rs:325
4732024-11-06T23:57:49.271ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a file = illumos-utils/src/zone.rs:325
4742024-11-06T23:57:49.275ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41 file = illumos-utils/src/zone.rs:325
4752024-11-06T23:57:49.287ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189 file = illumos-utils/src/zone.rs:363
4762024-11-06T23:57:49.292ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a file = illumos-utils/src/zone.rs:363
4772024-11-06T23:57:49.295ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41 file = illumos-utils/src/zone.rs:363
4782024-11-06T23:57:49.530ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/69a45541-8490-420b-8636-983c871692fd) file = sled-agent/src/probe_manager.rs:231 sled_id = 69a45541-8490-420b-8636-983c871692fd
4792024-11-06T23:57:50.817ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4802024-11-06T23:57:50.817ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4812024-11-06T23:57:50.817ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
4822024-11-06T23:57:51.300ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4832024-11-06T23:57:51.778ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4842024-11-06T23:57:51.778ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4852024-11-06T23:57:51.779ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4862024-11-06T23:57:51.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 30.034665ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
4872024-11-06T23:57:51.787ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
4882024-11-06T23:57:51.791ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
4892024-11-06T23:57:51.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 90.123304ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
4902024-11-06T23:57:51.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 30.398284ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
4912024-11-06T23:57:51.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 66.701621ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
4922024-11-06T23:57:51.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 114.689109ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
4932024-11-06T23:57:51.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 125.744355ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
4942024-11-06T23:57:52.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 128.405857ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
4952024-11-06T23:57:52.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 511.28838ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
4962024-11-06T23:57:52.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 219.621497ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
4972024-11-06T23:57:52.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 260.306165ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
4982024-11-06T23:57:52.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 234.86487ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
4992024-11-06T23:57:52.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 263.073171ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5002024-11-06T23:57:52.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 580.854605ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
5012024-11-06T23:57:52.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 851.938082ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
5022024-11-06T23:57:52.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 1.01437439s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5032024-11-06T23:57:53.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 561.734773ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
5042024-11-06T23:57:53.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 1.045802746s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
5052024-11-06T23:57:53.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 903.53786ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5062024-11-06T23:57:53.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 958.607471ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
5072024-11-06T23:57:54.359ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7223562547043155902 sled_id = 69a45541-8490-420b-8636-983c871692fd
5082024-11-06T23:57:54.359ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11420160953593402632 sled_id = 69a45541-8490-420b-8636-983c871692fd
5092024-11-06T23:57:54.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 1.418965543s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
5102024-11-06T23:57:54.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 762.246213ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5112024-11-06T23:57:54.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 1.06164515s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
5122024-11-06T23:57:54.829ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4255
5132024-11-06T23:57:54.829ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4265 gateway = fd00:1122:3344:101::1
5142024-11-06T23:57:54.835ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4344
5152024-11-06T23:57:54.936ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4392
5162024-11-06T23:57:54.936ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4419
5172024-11-06T23:57:54.975ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4432
5182024-11-06T23:57:54.975ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4296
5192024-11-06T23:57:55.026ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4338
5202024-11-06T23:57:55.026ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4399 rack_subnet = fd00:1122:3344::
5212024-11-06T23:57:55.046ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4410
5222024-11-06T23:57:55.046ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4452
5232024-11-06T23:57:55.113ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4484
5242024-11-06T23:57:55.113ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4490
5252024-11-06T23:57:55.199ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4531
5262024-11-06T23:57:55.199ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5272024-11-06T23:57:55.232ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 60.855372ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5282024-11-06T23:57:55.294ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 113.608159ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5292024-11-06T23:57:55.408ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 265.77242ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5302024-11-06T23:57:55.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 600.935494ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5312024-11-06T23:57:55.675ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 334.377399ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5322024-11-06T23:57:55.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189") failed: Property not found. retry in 1.136627477s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
5332024-11-06T23:57:55.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a") failed: Property not found. retry in 819.962173ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
5342024-11-06T23:57:55.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:32786
5352024-11-06T23:57:55.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:32786 req_id = a8c29e80-de52-4987-93f2-3915688d3e21 response_code = 200 uri = /sled-identifiers
5362024-11-06T23:57:56.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2937391394269391503 sled_id = 69a45541-8490-420b-8636-983c871692fd
5372024-11-06T23:57:56.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12419165894931887427 sled_id = 69a45541-8490-420b-8636-983c871692fd
5382024-11-06T23:57:56.011ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5392024-11-06T23:57:56.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 670.608176ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5402024-11-06T23:57:56.046ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5412024-11-06T23:57:56.046ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5422024-11-06T23:57:56.047ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
5432024-11-06T23:57:56.047ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5442024-11-06T23:57:56.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
5452024-11-06T23:57:56.136ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5462024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5472024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5482024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5492024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5502024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5512024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5522024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5532024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5542024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5552024-11-06T23:57:56.136ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5562024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5572024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5582024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5592024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5602024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5612024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5622024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5632024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5642024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5652024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5662024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5672024-11-06T23:57:56.137ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5682024-11-06T23:57:56.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41") failed: Property not found. retry in 597.370126ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5692024-11-06T23:57:57.327ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_966c780a-9775-42cd-94b6-1c4592827189
5702024-11-06T23:57:57.328ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_99fab1e4-193f-4a0a-8a20-4f79541f6c6a
5712024-11-06T23:57:57.328ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_3817b532-d8fa-4620-bf75-3656f01b6f41
5722024-11-06T23:57:57.328ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5732024-11-06T23:57:57.328ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5742024-11-06T23:57:57.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8302595 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42918 req_id = 83acecb0-de2c-470b-9b0e-c907629683e6 response_code = 204 uri = /omicron-zones
5752024-11-06T23:57:57.331ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5762024-11-06T23:57:57.385ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5772024-11-06T23:57:57.431ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5782024-11-06T23:57:57.477ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5792024-11-06T23:57:57.477ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5802024-11-06T23:57:57.509ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5812024-11-06T23:57:57.509ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5822024-11-06T23:57:57.509ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5832024-11-06T23:57:57.538ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 966c780a-9775-42cd-94b6-1c4592827189 (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3817b532-d8fa-4620-bf75-3656f01b6f41 (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a (service), filesystem_pool: Some(ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 9748477a-aca9-465c-a689-e6c869ddab9d (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dd8d43dd-14c1-4361-83e1-18508442b6bc, kind: Service { id: 9748477a-aca9-465c-a689-e6c869ddab9d }, name: Name("ntp-9748477a-aca9-465c-a689-e6c869ddab9d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 29])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5842024-11-06T23:57:57.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53667
5852024-11-06T23:57:57.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5862024-11-06T23:57:57.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }
5872024-11-06T23:57:57.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5882024-11-06T23:57:57.575ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }
5892024-11-06T23:57:57.613ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5902024-11-06T23:57:57.613ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5912024-11-06T23:57:57.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5922024-11-06T23:57:57.653ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
5932024-11-06T23:57:57.653ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
5942024-11-06T23:57:57.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5952024-11-06T23:57:57.665ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5962024-11-06T23:57:57.696ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5972024-11-06T23:57:57.697ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5982024-11-06T23:57:57.697ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5992024-11-06T23:57:57.726ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 216, 29]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
6002024-11-06T23:57:57.726ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
6012024-11-06T23:57:57.727ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
6022024-11-06T23:57:57.727ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
6032024-11-06T23:57:57.727ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
6042024-11-06T23:57:57.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6052024-11-06T23:57:57.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d file = illumos-utils/src/zone.rs:325
6062024-11-06T23:57:57.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d file = illumos-utils/src/zone.rs:363
6072024-11-06T23:57:58.393ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6082024-11-06T23:57:58.393ZINFOSledAgent (ServiceManager): Booting oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6092024-11-06T23:57:58.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 53.688927ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6102024-11-06T23:57:58.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 120.244455ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6112024-11-06T23:57:58.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 240.662653ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6122024-11-06T23:57:59.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 324.953057ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6132024-11-06T23:57:59.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 842.552288ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6142024-11-06T23:58:00.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 876.992611ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6152024-11-06T23:58:01.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 856.740434ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6162024-11-06T23:58:01.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d") failed: Property not found. retry in 1.496925352s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6172024-11-06T23:58:03.476ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d
6182024-11-06T23:58:03.476ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6192024-11-06T23:58:03.477ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6202024-11-06T23:58:03.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5939065 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53667 req_id = af4a12e3-a317-44d3-923a-54b1dbf5d270 response_code = 204 uri = /omicron-zones
6212024-11-06T23:58:03.479ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6222024-11-06T23:58:03.509ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6232024-11-06T23:58:03.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50325
6242024-11-06T23:58:03.517ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6252024-11-06T23:58:03.517ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8633 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50325 req_id = 7179efe7-77cc-4923-854b-f739054e1622 response_code = 500 uri = /timesync
6262024-11-06T23:58:03.520ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6272024-11-06T23:58:03.628ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6282024-11-06T23:58:03.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44916
6292024-11-06T23:58:04.361ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7223562547043155902 sled_id = 69a45541-8490-420b-8636-983c871692fd
6302024-11-06T23:58:04.361ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11420160953593402632 sled_id = 69a45541-8490-420b-8636-983c871692fd
6312024-11-06T23:58:06.006ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2937391394269391503 sled_id = 69a45541-8490-420b-8636-983c871692fd
6322024-11-06T23:58:06.006ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12419165894931887427 sled_id = 69a45541-8490-420b-8636-983c871692fd
6332024-11-06T23:58:06.800ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17460552322170300530 sled_id = 69a45541-8490-420b-8636-983c871692fd
6342024-11-06T23:58:06.949ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7672009049058901804 sled_id = 69a45541-8490-420b-8636-983c871692fd
6352024-11-06T23:58:07.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3479609843906295755 sled_id = 69a45541-8490-420b-8636-983c871692fd
6362024-11-06T23:58:07.638ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6372024-11-06T23:58:07.638ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008984 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44916 req_id = 7e017c51-3c35-435c-888f-9d335dd55d05 response_code = 500 uri = /timesync
6382024-11-06T23:58:07.640ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6392024-11-06T23:58:07.786ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6402024-11-06T23:58:07.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47575
6412024-11-06T23:58:07.794ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6422024-11-06T23:58:07.794ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8544 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47575 req_id = b2ea07d9-5f67-4cae-bf55-cd343af8e447 response_code = 500 uri = /timesync
6432024-11-06T23:58:07.798ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6442024-11-06T23:58:08.041ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6452024-11-06T23:58:08.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57873
6462024-11-06T23:58:08.049ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6472024-11-06T23:58:08.049ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8454 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d708bcaa-d0c3-4f9b-87eb-260e907f4322 response_code = 500 uri = /timesync
6482024-11-06T23:58:08.052ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6492024-11-06T23:58:08.311ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6502024-11-06T23:58:08.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62810
6512024-11-06T23:58:09.320ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6522024-11-06T23:58:09.320ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 1008380 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62810 req_id = 527b1f7c-bba3-4122-a7f7-dbc0025511e7 response_code = 500 uri = /timesync
6532024-11-06T23:58:09.322ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6542024-11-06T23:58:09.488ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6552024-11-06T23:58:09.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51155
6562024-11-06T23:58:09.496ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6572024-11-06T23:58:09.496ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51155 req_id = 33e32020-98a3-4893-9c53-66ce56cc6497 response_code = 500 uri = /timesync
6582024-11-06T23:58:09.500ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6592024-11-06T23:58:09.657ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6602024-11-06T23:58:09.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61389
6612024-11-06T23:58:13.234ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 248.76951ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 69a45541-8490-420b-8636-983c871692fd
6622024-11-06T23:58:13.484ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7193327530535487351 sled_id = 69a45541-8490-420b-8636-983c871692fd
6632024-11-06T23:58:13.484ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17095965317615109245 sled_id = 69a45541-8490-420b-8636-983c871692fd
6642024-11-06T23:58:13.670ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9748477a-aca9-465c-a689-e6c869ddab9d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6652024-11-06T23:58:13.670ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61389 req_id = 828aab59-5071-49a0-8e12-1193de514a73 response_code = 500 uri = /timesync
6662024-11-06T23:58:13.671ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6672024-11-06T23:58:13.889ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6682024-11-06T23:58:13.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59024
6692024-11-06T23:58:13.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59024 req_id = fcd0e4f4-bef7-4bd1-81af-8605c3083a73 response_code = 200 uri = /timesync
6702024-11-06T23:58:13.901ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.002502976 } file = sled-agent/src/rack_setup/service.rs:661
6712024-11-06T23:58:13.901ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6722024-11-06T23:58:14.263ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6732024-11-06T23:58:14.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65239
6742024-11-06T23:58:14.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 20777 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65239 req_id = 474aa41f-196d-49ef-ad72-2736396b923e response_code = 200 uri = /timesync
6752024-11-06T23:58:14.288ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1662783218, ip_addr: 99.28.14.242, stratum: 2, ref_time: 1730937493.382939, correction: 0.002352041 } file = sled-agent/src/rack_setup/service.rs:661
6762024-11-06T23:58:14.288ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1308
6772024-11-06T23:58:14.318ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966c780a-9775-42cd-94b6-1c4592827189 (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3817b532-d8fa-4620-bf75-3656f01b6f41 (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a (service), filesystem_pool: Some(ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 9748477a-aca9-465c-a689-e6c869ddab9d (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dd8d43dd-14c1-4361-83e1-18508442b6bc, kind: Service { id: 9748477a-aca9-465c-a689-e6c869ddab9d }, name: Name("ntp-9748477a-aca9-465c-a689-e6c869ddab9d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 29])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } } } }, OmicronZoneConfig { id: a3997b4c-742c-45bc-9ebc-ea60eb8dbcce (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } } } }, OmicronZoneConfig { id: fe87a3a1-f8fb-4a3b-89ba-0d85754339e8 (service), filesystem_pool: Some(ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } } } }, OmicronZoneConfig { id: d5f4884c-a418-4f6f-8fd1-4bc4acb17015 (service), filesystem_pool: Some(ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External } } } }, OmicronZoneConfig { id: aeb3e9db-fe06-4f97-b815-e786c3b906e5 (service), filesystem_pool: Some(ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
6782024-11-06T23:58:14.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36894
6792024-11-06T23:58:14.318ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6802024-11-06T23:58:14.318ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6812024-11-06T23:58:14.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6822024-11-06T23:58:14.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }
6832024-11-06T23:58:14.391ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6842024-11-06T23:58:14.391ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6852024-11-06T23:58:14.421ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6862024-11-06T23:58:14.421ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Cockroach }, responder: ... }
6872024-11-06T23:58:14.471ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a3997b4c-742c-45bc-9ebc-ea60eb8dbcce, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6882024-11-06T23:58:14.471ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a3997b4c-742c-45bc-9ebc-ea60eb8dbcce, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: Cockroach }, responder: ... }
6892024-11-06T23:58:14.522ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fe87a3a1-f8fb-4a3b-89ba-0d85754339e8, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6902024-11-06T23:58:14.522ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: fe87a3a1-f8fb-4a3b-89ba-0d85754339e8, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: Cockroach }, responder: ... }
6912024-11-06T23:58:14.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d5f4884c-a418-4f6f-8fd1-4bc4acb17015, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6922024-11-06T23:58:14.575ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d5f4884c-a418-4f6f-8fd1-4bc4acb17015, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }, kind: Cockroach }, responder: ... }
6932024-11-06T23:58:14.625ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aeb3e9db-fe06-4f97-b815-e786c3b906e5, dataset_name: DatasetName { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6942024-11-06T23:58:14.625ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: aeb3e9db-fe06-4f97-b815-e786c3b906e5, dataset_name: DatasetName { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }, kind: Cockroach }, responder: ... }
6952024-11-06T23:58:14.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6962024-11-06T23:58:14.676ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
6972024-11-06T23:58:14.677ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
6982024-11-06T23:58:14.677ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6992024-11-06T23:58:14.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7002024-11-06T23:58:14.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7012024-11-06T23:58:14.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7022024-11-06T23:58:14.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7032024-11-06T23:58:14.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7042024-11-06T23:58:14.844ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce file = illumos-utils/src/zone.rs:325
7052024-11-06T23:58:14.848ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015 file = illumos-utils/src/zone.rs:325
7062024-11-06T23:58:14.852ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5 file = illumos-utils/src/zone.rs:325
7072024-11-06T23:58:14.856ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a file = illumos-utils/src/zone.rs:325
7082024-11-06T23:58:14.860ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8 file = illumos-utils/src/zone.rs:325
7092024-11-06T23:58:14.865ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce file = illumos-utils/src/zone.rs:363
7102024-11-06T23:58:14.869ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015 file = illumos-utils/src/zone.rs:363
7112024-11-06T23:58:14.874ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5 file = illumos-utils/src/zone.rs:363
7122024-11-06T23:58:14.880ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a file = illumos-utils/src/zone.rs:363
7132024-11-06T23:58:14.885ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8 file = illumos-utils/src/zone.rs:363
7142024-11-06T23:58:17.745ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d5f4884c-a418-4f6f-8fd1-4bc4acb17015'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7152024-11-06T23:58:17.745ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='fe87a3a1-f8fb-4a3b-89ba-0d85754339e8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7162024-11-06T23:58:17.745ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7172024-11-06T23:58:17.750ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7182024-11-06T23:58:17.801ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7192024-11-06T23:58:17.801ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7202024-11-06T23:58:17.864ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='aeb3e9db-fe06-4f97-b815-e786c3b906e5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7212024-11-06T23:58:17.864ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7222024-11-06T23:58:17.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 39.380613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7232024-11-06T23:58:17.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 68.672641ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7242024-11-06T23:58:17.897ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a3997b4c-742c-45bc-9ebc-ea60eb8dbcce'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7252024-11-06T23:58:17.897ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7262024-11-06T23:58:17.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 135.979774ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7272024-11-06T23:58:17.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 43.484901ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7282024-11-06T23:58:18.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 130.711335ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7292024-11-06T23:58:18.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 162.18681ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7302024-11-06T23:58:18.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 90.663667ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7312024-11-06T23:58:18.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 292.538892ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7322024-11-06T23:58:18.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 30.179529ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7332024-11-06T23:58:18.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 137.418786ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7342024-11-06T23:58:18.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 549.574975ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7352024-11-06T23:58:18.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 64.257164ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7362024-11-06T23:58:18.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 534.860683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7372024-11-06T23:58:18.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 205.050611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7382024-11-06T23:58:18.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 33.864385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7392024-11-06T23:58:19.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 152.743823ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7402024-11-06T23:58:19.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 133.719543ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7412024-11-06T23:58:19.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 587.500132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7422024-11-06T23:58:19.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 555.497437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7432024-11-06T23:58:19.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 288.337278ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7442024-11-06T23:58:19.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 880.627626ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7452024-11-06T23:58:19.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.013547861s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7462024-11-06T23:58:19.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 381.536019ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7472024-11-06T23:58:19.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 424.360641ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7482024-11-06T23:58:19.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 1.071784624s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7492024-11-06T23:58:20.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 455.862052ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7502024-11-06T23:58:20.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 1.499705594s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7512024-11-06T23:58:20.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 547.133154ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7522024-11-06T23:58:20.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 947.324023ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7532024-11-06T23:58:20.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 1.056021187s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7542024-11-06T23:58:20.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 1.405438264s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7552024-11-06T23:58:20.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 1.390266605s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7562024-11-06T23:58:21.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 979.990754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7572024-11-06T23:58:21.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 1.467802531s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7582024-11-06T23:58:21.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 966.08624ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7592024-11-06T23:58:22.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 866.351976ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7602024-11-06T23:58:22.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 679.33621ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7612024-11-06T23:58:22.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.456395202s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7622024-11-06T23:58:22.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 1.319876856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7632024-11-06T23:58:23.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 788.123827ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7642024-11-06T23:58:23.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 1.300310892s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7652024-11-06T23:58:23.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 1.065217249s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7662024-11-06T23:58:23.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 598.175095ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7672024-11-06T23:58:23.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 975.675119ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7682024-11-06T23:58:24.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 849.829174ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7692024-11-06T23:58:24.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 619.300407ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7702024-11-06T23:58:24.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 829.118777ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7712024-11-06T23:58:24.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 923.063382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7722024-11-06T23:58:24.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 663.538205ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7732024-11-06T23:58:24.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 697.002009ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7742024-11-06T23:58:24.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 764.82567ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7752024-11-06T23:58:25.047ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65202
7762024-11-06T23:58:25.048ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65202 req_id = 18f73ed9-a5f0-479f-bca4-49e08ba587cb response_code = 200 uri = /baseboard
7772024-11-06T23:58:25.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 997.552278ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7782024-11-06T23:58:25.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 808.676332ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7792024-11-06T23:58:25.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 916.380862ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7802024-11-06T23:58:25.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 1.110542345s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7812024-11-06T23:58:25.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5") failed: Property not found. retry in 1.493093363s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7822024-11-06T23:58:26.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015") failed: Property not found. retry in 989.534486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7832024-11-06T23:58:26.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce") failed: Property not found. retry in 1.110225423s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7842024-11-06T23:58:26.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.327212813s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7852024-11-06T23:58:26.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8") failed: Property not found. retry in 1.184474556s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
7862024-11-06T23:58:27.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.398282109s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7872024-11-06T23:58:28.521ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 567.242991ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 69a45541-8490-420b-8636-983c871692fd
7882024-11-06T23:58:29.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 534.594872ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7892024-11-06T23:58:30.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.452039554s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7902024-11-06T23:58:31.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 718.832409ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7912024-11-06T23:58:32.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 565.900233ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7922024-11-06T23:58:32.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 829.059856ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7932024-11-06T23:58:33.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.223603305s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7942024-11-06T23:58:34.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.331752897s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7952024-11-06T23:58:36.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a") failed: Property not found. retry in 1.134854931s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
7962024-11-06T23:58:37.462ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_a3997b4c-742c-45bc-9ebc-ea60eb8dbcce
7972024-11-06T23:58:37.462ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_d5f4884c-a418-4f6f-8fd1-4bc4acb17015
7982024-11-06T23:58:37.462ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_aeb3e9db-fe06-4f97-b815-e786c3b906e5
7992024-11-06T23:58:37.462ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a
8002024-11-06T23:58:37.462ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_fe87a3a1-f8fb-4a3b-89ba-0d85754339e8
8012024-11-06T23:58:37.462ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8022024-11-06T23:58:37.468ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8032024-11-06T23:58:37.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23158689 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36894 req_id = 36b00d8b-523e-4dc0-bfca-a76408f9e544 response_code = 204 uri = /omicron-zones
8042024-11-06T23:58:37.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35226
8052024-11-06T23:58:37.540ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 27956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35226 req_id = af774dbd-994a-467d-8b73-ccf3197e46f5 response_code = 500 uri = /cockroachdb
8062024-11-06T23:58:37.540ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "af774dbd-994a-467d-8b73-ccf3197e46f5", "content-length": "124", "date": "Wed, 06 Nov 2024 23:58:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "af774dbd-994a-467d-8b73-ccf3197e46f5" } file = sled-agent/src/rack_setup/service.rs:1037 retry_after = 79.886564ms
8072024-11-06T23:58:37.646ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3706
8082024-11-06T23:58:44.797ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3724
8092024-11-06T23:58:57.324ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3747
8102024-11-06T23:58:57.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19704388 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35226 req_id = 13a1c73b-27e2-4cc2-8188-3b15c6690784 response_code = 204 uri = /cockroachdb
8112024-11-06T23:58:57.325ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38322
8122024-11-06T23:58:57.325ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38322 req_id = 31933b07-7a66-402f-a917-8117015b4d33 response_code = 200 uri = /baseboard
8132024-11-06T23:58:57.329ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 790.077422ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 69a45541-8490-420b-8636-983c871692fd
8142024-11-06T23:58:57.360ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 966c780a-9775-42cd-94b6-1c4592827189 (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3817b532-d8fa-4620-bf75-3656f01b6f41 (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a (service), filesystem_pool: Some(ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 9748477a-aca9-465c-a689-e6c869ddab9d (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dd8d43dd-14c1-4361-83e1-18508442b6bc, kind: Service { id: 9748477a-aca9-465c-a689-e6c869ddab9d }, name: Name("ntp-9748477a-aca9-465c-a689-e6c869ddab9d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 29])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } } } }, OmicronZoneConfig { id: a3997b4c-742c-45bc-9ebc-ea60eb8dbcce (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } } } }, OmicronZoneConfig { id: fe87a3a1-f8fb-4a3b-89ba-0d85754339e8 (service), filesystem_pool: Some(ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } } } }, OmicronZoneConfig { id: d5f4884c-a418-4f6f-8fd1-4bc4acb17015 (service), filesystem_pool: Some(ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External } } } }, OmicronZoneConfig { id: aeb3e9db-fe06-4f97-b815-e786c3b906e5 (service), filesystem_pool: Some(ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External } } } }, OmicronZoneConfig { id: a7af845e-5f6a-4084-832d-89ca63641910 (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 55932d39-c4ea-4c43-8a53-3921686b4728 (service), filesystem_pool: Some(ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e (service), filesystem_pool: Some(ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f (service), filesystem_pool: Some(ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 7a13aa4d-214f-4c49-8977-3c4c2a2350e1 (service), filesystem_pool: Some(ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 5827e604-a2d7-4e90-9041-13d12d164ec4 (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } } } }, OmicronZoneConfig { id: 43cd8507-e2db-45a2-aa8c-49430b6f1686 (service), filesystem_pool: Some(ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 9037e083-b0b5-4c30-b398-e6c41441b6d8 (service), filesystem_pool: Some(ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 7183d2f4-2731-4fb7-a8ab-5e78939f605c (service), filesystem_pool: Some(ZpoolName { id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 10be3d30-968d-452c-b247-b24a099a0bd3 (service), filesystem_pool: Some(ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External } } } }, OmicronZoneConfig { id: 80d5ed4e-fb21-4ab4-b643-b0da942c1cf4 (service), filesystem_pool: Some(ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External } } } }, OmicronZoneConfig { id: 92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b (service), filesystem_pool: Some(ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External } } } }, OmicronZoneConfig { id: 516e945a-036b-4c02-90de-e63060cd67c4 (service), filesystem_pool: Some(ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External } } } }, OmicronZoneConfig { id: 1d767587-b394-4b1d-92ea-d5c01f8af0fe (service), filesystem_pool: Some(ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External } } } }, OmicronZoneConfig { id: 78381b69-b0a0-4077-84b2-d8b7ae3731d4 (service), filesystem_pool: Some(ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b (service), filesystem_pool: Some(ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1874ea5d-d047-480d-aa8c-f7baf65a8217 (service), filesystem_pool: Some(ZpoolName { id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool), kind: External } } } }, OmicronZoneConfig { id: 96e2a850-e96a-4c94-8fb9-d4aaa7f96d64 (service), filesystem_pool: Some(ZpoolName { id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
8152024-11-06T23:58:57.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47603
8162024-11-06T23:58:57.361ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8172024-11-06T23:58:57.361ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 966c780a-9775-42cd-94b6-1c4592827189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8182024-11-06T23:58:57.416ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8192024-11-06T23:58:57.416ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3817b532-d8fa-4620-bf75-3656f01b6f41, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: InternalDns }, responder: ... }
8202024-11-06T23:58:57.462ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8212024-11-06T23:58:57.462ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 99fab1e4-193f-4a0a-8a20-4f79541f6c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8222024-11-06T23:58:57.507ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8232024-11-06T23:58:57.507ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2e1383d9-9b3f-4c6f-ae2e-17ef4c70815a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Cockroach }, responder: ... }
8242024-11-06T23:58:57.552ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a3997b4c-742c-45bc-9ebc-ea60eb8dbcce, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8252024-11-06T23:58:57.552ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a3997b4c-742c-45bc-9ebc-ea60eb8dbcce, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: Cockroach }, responder: ... }
8262024-11-06T23:58:57.593ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fe87a3a1-f8fb-4a3b-89ba-0d85754339e8, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8272024-11-06T23:58:57.593ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: fe87a3a1-f8fb-4a3b-89ba-0d85754339e8, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8282024-11-06T23:58:57.637ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d5f4884c-a418-4f6f-8fd1-4bc4acb17015, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8292024-11-06T23:58:57.637ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d5f4884c-a418-4f6f-8fd1-4bc4acb17015, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }, kind: Cockroach }, responder: ... }
8302024-11-06T23:58:57.684ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aeb3e9db-fe06-4f97-b815-e786c3b906e5, dataset_name: DatasetName { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8312024-11-06T23:58:57.684ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: aeb3e9db-fe06-4f97-b815-e786c3b906e5, dataset_name: DatasetName { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }, kind: Cockroach }, responder: ... }
8322024-11-06T23:58:57.724ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a7af845e-5f6a-4084-832d-89ca63641910, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8332024-11-06T23:58:57.724ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a7af845e-5f6a-4084-832d-89ca63641910, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8342024-11-06T23:58:57.819ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8352024-11-06T23:58:57.819ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8362024-11-06T23:58:57.904ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5827e604-a2d7-4e90-9041-13d12d164ec4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
8372024-11-06T23:58:57.904ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5827e604-a2d7-4e90-9041-13d12d164ec4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8382024-11-06T23:58:57.990ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 10be3d30-968d-452c-b247-b24a099a0bd3, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8392024-11-06T23:58:57.990ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 10be3d30-968d-452c-b247-b24a099a0bd3, dataset_name: DatasetName { pool_name: ZpoolName { id: 3da17e53-d384-4209-aa7d-1c0e0650f28d (zpool), kind: External }, kind: Crucible }, responder: ... }
8402024-11-06T23:58:58.076ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 80d5ed4e-fb21-4ab4-b643-b0da942c1cf4, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8412024-11-06T23:58:58.076ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 80d5ed4e-fb21-4ab4-b643-b0da942c1cf4, dataset_name: DatasetName { pool_name: ZpoolName { id: 737b2345-38a9-43c1-8e04-028013083dab (zpool), kind: External }, kind: Crucible }, responder: ... }
8422024-11-06T23:58:58.163ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8432024-11-06T23:58:58.163ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b, dataset_name: DatasetName { pool_name: ZpoolName { id: 77b9d04f-ff62-4bf6-80b6-1ba59410cf90 (zpool), kind: External }, kind: Crucible }, responder: ... }
8442024-11-06T23:58:58.245ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 516e945a-036b-4c02-90de-e63060cd67c4, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8452024-11-06T23:58:58.245ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 516e945a-036b-4c02-90de-e63060cd67c4, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e9aa741-c339-4c7e-bd6a-302462e9a45d (zpool), kind: External }, kind: Crucible }, responder: ... }
8462024-11-06T23:58:58.347ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1d767587-b394-4b1d-92ea-d5c01f8af0fe, dataset_name: DatasetName { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8472024-11-06T23:58:58.347ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1d767587-b394-4b1d-92ea-d5c01f8af0fe, dataset_name: DatasetName { pool_name: ZpoolName { id: b526a174-72fc-4230-a1f2-853297828dee (zpool), kind: External }, kind: Crucible }, responder: ... }
8482024-11-06T23:58:58.427ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78381b69-b0a0-4077-84b2-d8b7ae3731d4, dataset_name: DatasetName { pool_name: ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8492024-11-06T23:58:58.427ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 78381b69-b0a0-4077-84b2-d8b7ae3731d4, dataset_name: DatasetName { pool_name: ZpoolName { id: 21b357d6-ee4d-46ce-a662-7388891b2eb0 (zpool), kind: External }, kind: Crucible }, responder: ... }
8502024-11-06T23:58:58.527ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b, dataset_name: DatasetName { pool_name: ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8512024-11-06T23:58:58.527ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b, dataset_name: DatasetName { pool_name: ZpoolName { id: 25e5b8a8-6c0f-412b-8992-b44def269af8 (zpool), kind: External }, kind: Crucible }, responder: ... }
8522024-11-06T23:58:58.618ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1874ea5d-d047-480d-aa8c-f7baf65a8217, dataset_name: DatasetName { pool_name: ZpoolName { id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8532024-11-06T23:58:58.618ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1874ea5d-d047-480d-aa8c-f7baf65a8217, dataset_name: DatasetName { pool_name: ZpoolName { id: ae074693-ac16-4071-b410-16e9a1afa3ad (zpool), kind: External }, kind: Crucible }, responder: ... }
8542024-11-06T23:58:58.704ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 96e2a850-e96a-4c94-8fb9-d4aaa7f96d64, dataset_name: DatasetName { pool_name: ZpoolName { id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8552024-11-06T23:58:58.704ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 96e2a850-e96a-4c94-8fb9-d4aaa7f96d64, dataset_name: DatasetName { pool_name: ZpoolName { id: aa9b2bf5-6331-4c37-9308-cee886ded211 (zpool), kind: External }, kind: Crucible }, responder: ... }
8562024-11-06T23:58:58.795ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8572024-11-06T23:58:58.795ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
8582024-11-06T23:58:58.795ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
8592024-11-06T23:58:58.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8602024-11-06T23:58:58.948ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8612024-11-06T23:58:58.948ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8622024-11-06T23:58:58.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8632024-11-06T23:58:58.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8642024-11-06T23:58:58.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8652024-11-06T23:58:58.986ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8662024-11-06T23:58:58.986ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8672024-11-06T23:58:58.986ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8682024-11-06T23:58:58.986ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8692024-11-06T23:58:58.988ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8702024-11-06T23:58:59.171ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8712024-11-06T23:58:59.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8722024-11-06T23:58:59.198ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8732024-11-06T23:58:59.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8742024-11-06T23:58:59.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8752024-11-06T23:58:59.200ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8762024-11-06T23:58:59.214ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8772024-11-06T23:58:59.214ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8782024-11-06T23:58:59.214ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8792024-11-06T23:58:59.215ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe file = illumos-utils/src/zone.rs:325
8802024-11-06T23:58:59.220ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b file = illumos-utils/src/zone.rs:325
8812024-11-06T23:58:59.227ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217 file = illumos-utils/src/zone.rs:325
8822024-11-06T23:58:59.232ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64 file = illumos-utils/src/zone.rs:325
8832024-11-06T23:58:59.237ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1 file = illumos-utils/src/zone.rs:325
8842024-11-06T23:58:59.242ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3 file = illumos-utils/src/zone.rs:325
8852024-11-06T23:58:59.247ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4 file = illumos-utils/src/zone.rs:325
8862024-11-06T23:58:59.253ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8 file = illumos-utils/src/zone.rs:325
8872024-11-06T23:58:59.375ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe file = illumos-utils/src/zone.rs:363
8882024-11-06T23:58:59.380ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b file = illumos-utils/src/zone.rs:363
8892024-11-06T23:58:59.384ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217 file = illumos-utils/src/zone.rs:363
8902024-11-06T23:58:59.388ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64 file = illumos-utils/src/zone.rs:363
8912024-11-06T23:58:59.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1 file = illumos-utils/src/zone.rs:363
8922024-11-06T23:58:59.398ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3 file = illumos-utils/src/zone.rs:363
8932024-11-06T23:58:59.403ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4 file = illumos-utils/src/zone.rs:363
8942024-11-06T23:58:59.408ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8 file = illumos-utils/src/zone.rs:363
8952024-11-06T23:58:59.413ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4 file = illumos-utils/src/zone.rs:325
8962024-11-06T23:58:59.418ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4 file = illumos-utils/src/zone.rs:325
8972024-11-06T23:58:59.424ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4 file = illumos-utils/src/zone.rs:325
8982024-11-06T23:58:59.429ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686 file = illumos-utils/src/zone.rs:325
8992024-11-06T23:58:59.435ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c file = illumos-utils/src/zone.rs:325
9002024-11-06T23:58:59.439ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b file = illumos-utils/src/zone.rs:325
9012024-11-06T23:58:59.445ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4 file = illumos-utils/src/zone.rs:363
9022024-11-06T23:58:59.449ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4 file = illumos-utils/src/zone.rs:363
9032024-11-06T23:58:59.455ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4 file = illumos-utils/src/zone.rs:363
9042024-11-06T23:58:59.463ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686 file = illumos-utils/src/zone.rs:363
9052024-11-06T23:58:59.467ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c file = illumos-utils/src/zone.rs:363
9062024-11-06T23:58:59.471ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b file = illumos-utils/src/zone.rs:363
9072024-11-06T23:58:59.522ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9082024-11-06T23:58:59.582ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9092024-11-06T23:58:59.645ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9102024-11-06T23:58:59.700ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9112024-11-06T23:58:59.760ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9122024-11-06T23:58:59.762ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9132024-11-06T23:58:59.762ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9142024-11-06T23:58:59.815ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 168, 72]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9152024-11-06T23:58:59.815ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9162024-11-06T23:58:59.818ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9172024-11-06T23:58:59.818ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9182024-11-06T23:58:59.884ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 253, 250]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9192024-11-06T23:58:59.884ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
9202024-11-06T23:58:59.886ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9212024-11-06T23:58:59.886ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9222024-11-06T23:58:59.941ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 223, 4]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9232024-11-06T23:58:59.941ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
9242024-11-06T23:58:59.943ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9252024-11-06T23:58:59.943ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9262024-11-06T23:59:00.002ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 203, 48]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9272024-11-06T23:59:00.002ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9282024-11-06T23:59:00.004ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9292024-11-06T23:59:00.004ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9302024-11-06T23:59:00.060ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 232, 56]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9312024-11-06T23:59:00.060ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9322024-11-06T23:59:00.060ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
9332024-11-06T23:59:00.060ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
9342024-11-06T23:59:00.061ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
9352024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
9362024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
9372024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
9382024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
9392024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
9402024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
9412024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
9422024-11-06T23:59:00.063ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
9432024-11-06T23:59:00.063ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9442024-11-06T23:59:00.131ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
9452024-11-06T23:59:00.134ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
9462024-11-06T23:59:00.138ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
9472024-11-06T23:59:00.138ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9482024-11-06T23:59:00.138ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9492024-11-06T23:59:00.141ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
9502024-11-06T23:59:00.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9512024-11-06T23:59:00.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9522024-11-06T23:59:00.364ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728 file = illumos-utils/src/zone.rs:325
9532024-11-06T23:59:00.372ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406 file = illumos-utils/src/zone.rs:325
9542024-11-06T23:59:00.379ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910 file = illumos-utils/src/zone.rs:325
9552024-11-06T23:59:00.386ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e file = illumos-utils/src/zone.rs:325
9562024-11-06T23:59:00.392ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f file = illumos-utils/src/zone.rs:325
9572024-11-06T23:59:00.400ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728 file = illumos-utils/src/zone.rs:363
9582024-11-06T23:59:00.409ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406 file = illumos-utils/src/zone.rs:363
9592024-11-06T23:59:00.418ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910 file = illumos-utils/src/zone.rs:363
9602024-11-06T23:59:00.425ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e file = illumos-utils/src/zone.rs:363
9612024-11-06T23:59:00.432ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f file = illumos-utils/src/zone.rs:363
9622024-11-06T23:59:03.615ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_25e5b8a8-6c0f-412b-8992-b44def269af8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a105ba13-4a40-4e4f-b1aa-cca4433aa99b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9632024-11-06T23:59:03.616ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
9642024-11-06T23:59:06.943ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2e9aa741-c339-4c7e-bd6a-302462e9a45d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7fc65054-1d8f-4046-bba0-fd432cac6f3f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9652024-11-06T23:59:06.959ZINFOSledAgent (ServiceManager): Booting oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
9662024-11-06T23:59:07.289ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b526a174-72fc-4230-a1f2-853297828dee/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f8298f6c-7335-4826-80a9-73a1751569ae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9672024-11-06T23:59:07.331ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ae074693-ac16-4071-b410-16e9a1afa3ad/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a8ff67b4-c556-4c97-ad72-e9c90b61f3a1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9682024-11-06T23:59:07.361ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_aa9b2bf5-6331-4c37-9308-cee886ded211/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e7af8605-cf1c-4339-b1bc-0b0d7080fb65'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9692024-11-06T23:59:07.413ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3da17e53-d384-4209-aa7d-1c0e0650f28d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2ddf7198-6675-4182-b707-a68b68748f60'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9702024-11-06T23:59:07.557ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_737b2345-38a9-43c1-8e04-028013083dab/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0f20f35b-3971-4689-9ae4-29f8bb0ba8fb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9712024-11-06T23:59:07.563ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
9722024-11-06T23:59:07.685ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
9732024-11-06T23:59:07.784ZINFOSledAgent (ServiceManager): Booting oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
9742024-11-06T23:59:07.853ZINFOSledAgent (ServiceManager): Booting oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
9752024-11-06T23:59:07.875ZINFOSledAgent (ServiceManager): Booting oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
9762024-11-06T23:59:07.929ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9772024-11-06T23:59:07.929ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
9782024-11-06T23:59:11.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 43.092957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
9792024-11-06T23:59:11.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 64.073429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
9802024-11-06T23:59:12.000ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9812024-11-06T23:59:12.001ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
9822024-11-06T23:59:12.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 189.451417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
9832024-11-06T23:59:12.023ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9842024-11-06T23:59:12.024ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
9852024-11-06T23:59:12.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 44.027643ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
9862024-11-06T23:59:12.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 56.992126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
9872024-11-06T23:59:12.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 31.975928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
9882024-11-06T23:59:12.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 53.506324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
9892024-11-06T23:59:12.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 40.57151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
9902024-11-06T23:59:12.098ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_21b357d6-ee4d-46ce-a662-7388891b2eb0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='eb066c24-fc3e-43b0-be4b-7b6ab2b0775b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9912024-11-06T23:59:12.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 62.015991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
9922024-11-06T23:59:12.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 27.761991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
9932024-11-06T23:59:12.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 138.844249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
9942024-11-06T23:59:12.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 75.987735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
9952024-11-06T23:59:12.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 123.127771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
9962024-11-06T23:59:12.159ZINFOSledAgent (ServiceManager): Booting oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
9972024-11-06T23:59:12.168ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_77b9d04f-ff62-4bf6-80b6-1ba59410cf90/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8831ac24-a67b-4b5d-9b28-a226dcea0c72'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9982024-11-06T23:59:12.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 110.002741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
9992024-11-06T23:59:12.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 113.611475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
10002024-11-06T23:59:12.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 144.218036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
10012024-11-06T23:59:12.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 113.956125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
10022024-11-06T23:59:12.217ZINFOSledAgent (ServiceManager): Booting oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10032024-11-06T23:59:12.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 285.542948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
10042024-11-06T23:59:12.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 171.397757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
10052024-11-06T23:59:12.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 51.020981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
10062024-11-06T23:59:12.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 211.093303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
10072024-11-06T23:59:12.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 103.079728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
10082024-11-06T23:59:12.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 272.27608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
10092024-11-06T23:59:12.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 231.959022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
10102024-11-06T23:59:12.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 47.967922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
10112024-11-06T23:59:12.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 197.750716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
10122024-11-06T23:59:12.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 200.02282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
10132024-11-06T23:59:12.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 75.004172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
10142024-11-06T23:59:12.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 63.300679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
10152024-11-06T23:59:12.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 347.47803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
10162024-11-06T23:59:12.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 586.236517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
10172024-11-06T23:59:12.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 54.189656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
10182024-11-06T23:59:12.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 239.051986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
10192024-11-06T23:59:12.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 532.700796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
10202024-11-06T23:59:12.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 552.90302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
10212024-11-06T23:59:12.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 580.332565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
10222024-11-06T23:59:12.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 266.026423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
10232024-11-06T23:59:12.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 124.148588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
10242024-11-06T23:59:12.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 25.76068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10252024-11-06T23:59:12.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 464.77496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
10262024-11-06T23:59:12.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 458.451554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
10272024-11-06T23:59:12.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 655.160871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
10282024-11-06T23:59:12.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 436.882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
10292024-11-06T23:59:12.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 539.675216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
10302024-11-06T23:59:12.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 96.079869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10312024-11-06T23:59:12.934ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='7a13aa4d-214f-4c49-8977-3c4c2a2350e1'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10322024-11-06T23:59:12.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 150.582286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
10332024-11-06T23:59:12.951ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
10342024-11-06T23:59:13.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 286.170165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10352024-11-06T23:59:13.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 776.526005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
10362024-11-06T23:59:13.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 313.840585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
10372024-11-06T23:59:13.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 308.137135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
10382024-11-06T23:59:13.384ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.032368427s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 69a45541-8490-420b-8636-983c871692fd
10392024-11-06T23:59:13.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 928.340521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
10402024-11-06T23:59:13.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 1.160197981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
10412024-11-06T23:59:13.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 460.186171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
10422024-11-06T23:59:13.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 1.000560615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
10432024-11-06T23:59:13.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 71.964542ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
10442024-11-06T23:59:13.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 989.125085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
10452024-11-06T23:59:13.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 458.401697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
10462024-11-06T23:59:13.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 869.274317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
10472024-11-06T23:59:13.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 1.155709616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
10482024-11-06T23:59:13.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 854.28708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
10492024-11-06T23:59:13.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 542.431709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10502024-11-06T23:59:13.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 92.358433ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
10512024-11-06T23:59:13.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 1.434871096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
10522024-11-06T23:59:13.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 227.723749ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
10532024-11-06T23:59:13.818ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10542024-11-06T23:59:13.818ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
10552024-11-06T23:59:13.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 629.868004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
10562024-11-06T23:59:13.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 740.919012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
10572024-11-06T23:59:13.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 307.97644ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
10582024-11-06T23:59:13.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 760.982218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
10592024-11-06T23:59:14.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 58.882851ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
10602024-11-06T23:59:14.061ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10612024-11-06T23:59:14.062ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
10622024-11-06T23:59:14.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 128.627902ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
10632024-11-06T23:59:14.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 629.414334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10642024-11-06T23:59:14.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 156.297188ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
10652024-11-06T23:59:14.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 689.14827ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
10662024-11-06T23:59:14.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 1.131152378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
10672024-11-06T23:59:14.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 73.913257ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
10682024-11-06T23:59:14.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 360.137477ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
10692024-11-06T23:59:14.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 584.767118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
10702024-11-06T23:59:14.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 52.833434ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
10712024-11-06T23:59:14.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 1.404473176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
10722024-11-06T23:59:14.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 542.215211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
10732024-11-06T23:59:14.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 1.081290517s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
10742024-11-06T23:59:14.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 1.007368024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
10752024-11-06T23:59:14.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 113.812294ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
10762024-11-06T23:59:14.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 927.609733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
10772024-11-06T23:59:14.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 803.560491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
10782024-11-06T23:59:14.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 1.484018994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
10792024-11-06T23:59:14.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 968.607702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
10802024-11-06T23:59:14.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 543.92102ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
10812024-11-06T23:59:14.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 1.037698554s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
10822024-11-06T23:59:14.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 697.723156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10832024-11-06T23:59:15.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 850.864057ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
10842024-11-06T23:59:15.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 1.017819523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
10852024-11-06T23:59:15.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 1.252292773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
10862024-11-06T23:59:15.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 1.316981369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
10872024-11-06T23:59:15.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 993.298944ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
10882024-11-06T23:59:15.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 1.019195197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
10892024-11-06T23:59:15.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 1.22923688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
10902024-11-06T23:59:15.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 754.799915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
10912024-11-06T23:59:15.574ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10922024-11-06T23:59:15.574ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10932024-11-06T23:59:15.575ZINFOSledAgent (ServiceManager): Booting oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
10942024-11-06T23:59:15.589ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
10952024-11-06T23:59:15.600ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10962024-11-06T23:59:15.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 1.419432741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
10972024-11-06T23:59:15.619ZINFOSledAgent (ServiceManager): Booting oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
10982024-11-06T23:59:15.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 1.243999412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
10992024-11-06T23:59:15.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 1.40059554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
11002024-11-06T23:59:15.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 855.816531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
11012024-11-06T23:59:15.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 643.249801ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
11022024-11-06T23:59:15.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 1.391095877s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
11032024-11-06T23:59:15.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 914.552619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
11042024-11-06T23:59:15.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 50.677227ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11052024-11-06T23:59:15.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 57.944345ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11062024-11-06T23:59:15.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 50.084307ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11072024-11-06T23:59:15.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 89.729708ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11082024-11-06T23:59:16.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 122.43908ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11092024-11-06T23:59:16.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 59.950393ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11102024-11-06T23:59:16.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 1.240730682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
11112024-11-06T23:59:16.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 108.103933ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11122024-11-06T23:59:16.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 219.559036ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11132024-11-06T23:59:16.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 272.162532ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11142024-11-06T23:59:16.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 817.614501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
11152024-11-06T23:59:16.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 783.731604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
11162024-11-06T23:59:16.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 1.455873204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
11172024-11-06T23:59:16.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 304.364952ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11182024-11-06T23:59:16.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 659.602944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
11192024-11-06T23:59:16.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 848.175242ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
11202024-11-06T23:59:16.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 453.391356ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11212024-11-06T23:59:16.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 1.359479792s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
11222024-11-06T23:59:16.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 1.124552515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
11232024-11-06T23:59:16.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 353.215016ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11242024-11-06T23:59:16.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 554.162246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
11252024-11-06T23:59:16.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 456.224702ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11262024-11-06T23:59:16.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 1.20100903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
11272024-11-06T23:59:16.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 729.850139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
11282024-11-06T23:59:16.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 1.04295309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
11292024-11-06T23:59:16.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 881.187891ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11302024-11-06T23:59:16.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 610.299199ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11312024-11-06T23:59:17.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 1.413578277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
11322024-11-06T23:59:17.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 888.321697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
11332024-11-06T23:59:17.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 1.097252865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
11342024-11-06T23:59:17.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 1.437055972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
11352024-11-06T23:59:17.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 1.401875723s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
11362024-11-06T23:59:17.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 1.063168316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
11372024-11-06T23:59:17.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 573.392723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11382024-11-06T23:59:17.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 505.913871ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
11392024-11-06T23:59:17.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 1.047323821s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
11402024-11-06T23:59:17.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 575.794506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
11412024-11-06T23:59:17.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 805.584495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
11422024-11-06T23:59:17.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 979.394826ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11432024-11-06T23:59:17.608ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11442024-11-06T23:59:17.608ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
11452024-11-06T23:59:17.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 654.768461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
11462024-11-06T23:59:17.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 1.424614511s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
11472024-11-06T23:59:17.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 624.334516ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11482024-11-06T23:59:17.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 1.487652524s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11492024-11-06T23:59:17.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 33.869346ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
11502024-11-06T23:59:17.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 1.438738748s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
11512024-11-06T23:59:17.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 809.681856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
11522024-11-06T23:59:17.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 78.471262ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
11532024-11-06T23:59:17.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 938.912989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
11542024-11-06T23:59:18.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 1.336259546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
11552024-11-06T23:59:18.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 132.995927ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
11562024-11-06T23:59:18.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 1.244918987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
11572024-11-06T23:59:18.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 887.492897ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
11582024-11-06T23:59:18.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 535.968263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
11592024-11-06T23:59:18.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 691.540351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
11602024-11-06T23:59:18.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 475.172399ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
11612024-11-06T23:59:18.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 515.27847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
11622024-11-06T23:59:18.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 521.695621ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
11632024-11-06T23:59:18.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 616.309327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
11642024-11-06T23:59:18.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 1.448543048s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11652024-11-06T23:59:18.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 810.163288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
11662024-11-06T23:59:18.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 1.355354319s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11672024-11-06T23:59:18.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 1.321286015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
11682024-11-06T23:59:18.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 1.287694217s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
11692024-11-06T23:59:18.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 998.898478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
11702024-11-06T23:59:18.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 781.807466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
11712024-11-06T23:59:18.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 981.444315ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
11722024-11-06T23:59:18.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 739.927533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
11732024-11-06T23:59:18.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 932.931361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
11742024-11-06T23:59:18.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 1.061383332s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
11752024-11-06T23:59:19.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 779.629032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
11762024-11-06T23:59:19.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 671.187039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
11772024-11-06T23:59:19.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 750.073594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
11782024-11-06T23:59:19.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 1.115577901s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
11792024-11-06T23:59:19.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 1.197789366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
11802024-11-06T23:59:19.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 1.08541361s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
11812024-11-06T23:59:19.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 651.247424ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11822024-11-06T23:59:19.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 1.043556688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
11832024-11-06T23:59:19.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 1.477785371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
11842024-11-06T23:59:19.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 941.366468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
11852024-11-06T23:59:19.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 1.047868562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
11862024-11-06T23:59:19.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 1.278625111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
11872024-11-06T23:59:19.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 1.467159806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
11882024-11-06T23:59:19.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 1.281907412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
11892024-11-06T23:59:19.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 794.040365ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
11902024-11-06T23:59:19.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 1.00544508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
11912024-11-06T23:59:19.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 810.487772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
11922024-11-06T23:59:19.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 1.402249963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
11932024-11-06T23:59:19.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 1.226511756s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
11942024-11-06T23:59:19.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 694.727649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
11952024-11-06T23:59:19.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 688.167953ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
11962024-11-06T23:59:20.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 894.595383ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
11972024-11-06T23:59:20.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 824.204545ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
11982024-11-06T23:59:20.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 1.436406382s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
11992024-11-06T23:59:20.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 819.682125ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
12002024-11-06T23:59:20.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b") failed: Property not found. retry in 510.659129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
12012024-11-06T23:59:20.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 929.153703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
12022024-11-06T23:59:20.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 531.013885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
12032024-11-06T23:59:20.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 961.110464ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
12042024-11-06T23:59:20.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 543.843338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
12052024-11-06T23:59:20.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 1.224321148s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
12062024-11-06T23:59:20.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 755.883041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
12072024-11-06T23:59:20.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe") failed: Property not found. retry in 768.355685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
12082024-11-06T23:59:20.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 1.343122634s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
12092024-11-06T23:59:20.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 593.306959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
12102024-11-06T23:59:20.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 1.295119183s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
12112024-11-06T23:59:21.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64") failed: Property not found. retry in 1.117110277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
12122024-11-06T23:59:21.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4") failed: Property not found. retry in 598.565212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
12132024-11-06T23:59:21.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 588.021954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
12142024-11-06T23:59:21.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4") failed: Property not found. retry in 904.421939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
12152024-11-06T23:59:21.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 577.694027ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
12162024-11-06T23:59:21.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c") failed: Property not found. retry in 932.468658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
12172024-11-06T23:59:21.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b") failed: Property not found. retry in 1.488800303s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
12182024-11-06T23:59:21.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 630.902432ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
12192024-11-06T23:59:21.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686") failed: Property not found. retry in 528.238077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
12202024-11-06T23:59:21.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217") failed: Property not found. retry in 1.222378745s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
12212024-11-06T23:59:21.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3") failed: Property not found. retry in 1.022662988s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
12222024-11-06T23:59:21.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4") failed: Property not found. retry in 1.172411652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
12232024-11-06T23:59:21.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 1.268660843s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
12242024-11-06T23:59:21.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8") failed: Property not found. retry in 851.360986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
12252024-11-06T23:59:21.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 731.094511ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
12262024-11-06T23:59:21.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 1.464587069s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
12272024-11-06T23:59:21.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 1.07264745s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
12282024-11-06T23:59:22.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 697.707097ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
12292024-11-06T23:59:22.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 1.15270639s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
12302024-11-06T23:59:22.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 1.408001641s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
12312024-11-06T23:59:22.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 1.060422391s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
12322024-11-06T23:59:22.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 855.693109ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
12332024-11-06T23:59:22.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 659.405449ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
12342024-11-06T23:59:23.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 926.983511ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
12352024-11-06T23:59:23.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1") failed: Property not found. retry in 1.307026474s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
12362024-11-06T23:59:23.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 1.106411377s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
12372024-11-06T23:59:23.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 954.36653ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
12382024-11-06T23:59:23.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 1.153697175s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
12392024-11-06T23:59:23.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 883.503899ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
12402024-11-06T23:59:23.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 1.411454489s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
12412024-11-06T23:59:24.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406") failed: Property not found. retry in 1.373666434s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
12422024-11-06T23:59:24.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 1.382682924s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
12432024-11-06T23:59:24.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 1.01443134s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
12442024-11-06T23:59:24.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 765.718056ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
12452024-11-06T23:59:24.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 765.385113ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
12462024-11-06T23:59:25.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910") failed: Property not found. retry in 1.078420948s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
12472024-11-06T23:59:25.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f") failed: Property not found. retry in 913.489095ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
12482024-11-06T23:59:25.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728") failed: Property not found. retry in 937.648597ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
12492024-11-06T23:59:25.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4") failed: Property not found. retry in 1.009685212s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
12502024-11-06T23:59:25.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e") failed: Property not found. retry in 754.026314ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
12512024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_1d767587-b394-4b1d-92ea-d5c01f8af0fe
12522024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_6c47bbf0-7dc1-45c6-b2a2-56ed61a8877b
12532024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_1874ea5d-d047-480d-aa8c-f7baf65a8217
12542024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_96e2a850-e96a-4c94-8fb9-d4aaa7f96d64
12552024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_55932d39-c4ea-4c43-8a53-3921686b4728
12562024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_7a13aa4d-214f-4c49-8977-3c4c2a2350e1
12572024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_10be3d30-968d-452c-b247-b24a099a0bd3
12582024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_516e945a-036b-4c02-90de-e63060cd67c4
12592024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_34125c18-f6d2-4048-b0f8-8f7f8bc77406
12602024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_9037e083-b0b5-4c30-b398-e6c41441b6d8
12612024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_80d5ed4e-fb21-4ab4-b643-b0da942c1cf4
12622024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_a7af845e-5f6a-4084-832d-89ca63641910
12632024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_78381b69-b0a0-4077-84b2-d8b7ae3731d4
12642024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_5827e604-a2d7-4e90-9041-13d12d164ec4
12652024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e
12662024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_9892fd59-6e52-4f0e-9815-37a2f047ca6f
12672024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_43cd8507-e2db-45a2-aa8c-49430b6f1686
12682024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_7183d2f4-2731-4fb7-a8ab-5e78939f605c
12692024-11-06T23:59:26.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_92f5c2c1-1fe9-4e4d-8558-62aa38d69e4b
12702024-11-06T23:59:26.738ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12712024-11-06T23:59:26.743ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12722024-11-06T23:59:26.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29385568 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47603 req_id = 7786b575-40fb-40fa-9680-12f8f5967786 response_code = 204 uri = /omicron-zones
12732024-11-06T23:59:26.760ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1331
12742024-11-06T23:59:26.761ZINFOSledAgent (RSS): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
12752024-11-06T23:59:26.761ZINFOSledAgent (RSS): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
12762024-11-06T23:59:26.770ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
12772024-11-06T23:59:26.774ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:720
12782024-11-06T23:59:26.809ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:896
12792024-11-06T23:59:26.815ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12802024-11-06T23:59:26.957ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12812024-11-06T23:59:27.099ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12822024-11-06T23:59:27.225ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12832024-11-06T23:59:27.361ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12842024-11-06T23:59:27.421ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36596
12852024-11-06T23:59:27.423ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1352 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36596 req_id = dc817ab2-1bec-4d39-aedb-594f59034fb6 response_code = 200 uri = /baseboard
12862024-11-06T23:59:27.535ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12872024-11-06T23:59:27.800ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12882024-11-06T23:59:28.171ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12892024-11-06T23:59:28.461ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12902024-11-06T23:59:28.893ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12912024-11-06T23:59:29.614ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12922024-11-06T23:59:30.319ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12932024-11-06T23:59:30.504ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.243295737s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 69a45541-8490-420b-8636-983c871692fd
12942024-11-06T23:59:30.934ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12952024-11-06T23:59:32.075ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12962024-11-06T23:59:33.352ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12972024-11-06T23:59:33.782ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.220296356s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 69a45541-8490-420b-8636-983c871692fd
12982024-11-06T23:59:35.102ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/89bb4072-177e-4b94-98e6-7ed6416e7431/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
12992024-11-06T23:59:38.213ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4c88e250-715c-4874-884f-9fd957a361c3", "content-length": "173", "date": "Wed, 06 Nov 2024 23:59:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"89bb4072-177e-4b94-98e6-7ed6416e7431\"", request_id: "4c88e250-715c-4874-884f-9fd957a361c3" } file = sled-agent/src/rack_setup/service.rs:958
13002024-11-06T23:59:39.990ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5e474614-9b36-43fe-a89d-ab9e2327e0a1", "content-length": "173", "date": "Wed, 06 Nov 2024 23:59:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"89bb4072-177e-4b94-98e6-7ed6416e7431\"", request_id: "5e474614-9b36-43fe-a89d-ab9e2327e0a1" } file = sled-agent/src/rack_setup/service.rs:958
13012024-11-06T23:59:42.302ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "64f6897c-4f09-47dc-9d11-5e39c2607b4e", "content-length": "173", "date": "Wed, 06 Nov 2024 23:59:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"89bb4072-177e-4b94-98e6-7ed6416e7431\"", request_id: "64f6897c-4f09-47dc-9d11-5e39c2607b4e" } file = sled-agent/src/rack_setup/service.rs:958
13022024-11-06T23:59:48.512ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "294a2263-ad0f-483d-ba8e-13b1d0b93701", "content-length": "173", "date": "Wed, 06 Nov 2024 23:59:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"69a45541-8490-420b-8636-983c871692fd\"", request_id: "294a2263-ad0f-483d-ba8e-13b1d0b93701" } file = sled-agent/src/rack_setup/service.rs:958
13032024-11-06T23:59:51.525ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f5813639-06c2-4f8e-8b36-658bf00a35a5", "content-length": "173", "date": "Wed, 06 Nov 2024 23:59:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"69a45541-8490-420b-8636-983c871692fd\"", request_id: "f5813639-06c2-4f8e-8b36-658bf00a35a5" } file = sled-agent/src/rack_setup/service.rs:958
13042024-11-06T23:59:52.237ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:60942 remote_addr = [fd00:1122:3344:101::d]:39089 sled_id = 69a45541-8490-420b-8636-983c871692fd
13052024-11-06T23:59:52.426ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188333 local_addr = [fd00:1122:3344:101::1]:60942 method = GET remote_addr = [fd00:1122:3344:101::d]:39089 req_id = 50847f29-b60f-4647-9a06-e3c065763438 response_code = 200 sled_id = 69a45541-8490-420b-8636-983c871692fd uri = /69a45541-8490-420b-8636-983c871692fd
13062024-11-06T23:59:55.214ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6086a503-25e6-4605-b7eb-8a03c086361f", "content-length": "173", "date": "Wed, 06 Nov 2024 23:59:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"69a45541-8490-420b-8636-983c871692fd\"", request_id: "6086a503-25e6-4605-b7eb-8a03c086361f" } file = sled-agent/src/rack_setup/service.rs:958
13072024-11-06T23:59:57.467ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58149
13082024-11-06T23:59:57.470ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58149 req_id = 654efe62-3b8a-40c4-80e4-8803e793caf7 response_code = 200 uri = /baseboard
13092024-11-06T23:59:58.036ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "89eb958d-0396-4876-a6b5-5594450c7ffb", "content-length": "173", "date": "Wed, 06 Nov 2024 23:59:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"69a45541-8490-420b-8636-983c871692fd\"", request_id: "89eb958d-0396-4876-a6b5-5594450c7ffb" } file = sled-agent/src/rack_setup/service.rs:958
13102024-11-07T00:00:05.523ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2c378537-eb17-49c5-a7c5-6dade85e24e4", "content-length": "173", "date": "Thu, 07 Nov 2024 00:00:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"69a45541-8490-420b-8636-983c871692fd\"", request_id: "2c378537-eb17-49c5-a7c5-6dade85e24e4" } file = sled-agent/src/rack_setup/service.rs:958
13112024-11-07T00:00:10.753ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "091b7dbb-6381-4a71-9ab9-1dea520922d5", "content-length": "173", "date": "Thu, 07 Nov 2024 00:00:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"69a45541-8490-420b-8636-983c871692fd\"", request_id: "091b7dbb-6381-4a71-9ab9-1dea520922d5" } file = sled-agent/src/rack_setup/service.rs:958
13122024-11-07T00:00:15.433ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 69a45541-8490-420b-8636-983c871692fd
13132024-11-07T00:00:15.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59078
13142024-11-07T00:00:15.536ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
13152024-11-07T00:00:15.536ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
13162024-11-07T00:00:15.536ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
13172024-11-07T00:00:15.542ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
13182024-11-07T00:00:15.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226085 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59078 req_id = dacbd12b-b7a5-4e22-a8cd-d5a3b8c7e5cd response_code = 200 uri = /inventory
13192024-11-07T00:00:17.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45827
13202024-11-07T00:00:18.017ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
13212024-11-07T00:00:18.018ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13222024-11-07T00:00:18.018ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13232024-11-07T00:00:18.018ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13242024-11-07T00:00:18.018ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13252024-11-07T00:00:18.018ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13262024-11-07T00:00:18.018ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
13272024-11-07T00:00:18.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38464 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45827 req_id = 2d0379c9-a4f2-415d-b4c8-222fabc38974 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13282024-11-07T00:00:18.019ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:968
13292024-11-07T00:00:18.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50267
13302024-11-07T00:00:18.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
13312024-11-07T00:00:18.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
13322024-11-07T00:00:18.308ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
13332024-11-07T00:00:18.308ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
13342024-11-07T00:00:18.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50267 req_id = 13e7086d-b256-4a2a-9cd4-82068216b73a response_code = 200 uri = /inventory
13352024-11-07T00:00:18.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46360
13362024-11-07T00:00:18.570ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
13372024-11-07T00:00:18.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13382024-11-07T00:00:18.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13392024-11-07T00:00:18.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13402024-11-07T00:00:18.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13412024-11-07T00:00:18.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13422024-11-07T00:00:18.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
13432024-11-07T00:00:18.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 466 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46360 req_id = 576ff137-7ddb-4307-9936-087e93268d27 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13442024-11-07T00:00:18.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37438
13452024-11-07T00:00:18.623ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
13462024-11-07T00:00:18.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13472024-11-07T00:00:18.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13482024-11-07T00:00:18.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13492024-11-07T00:00:18.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13502024-11-07T00:00:18.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13512024-11-07T00:00:18.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
13522024-11-07T00:00:18.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37438 req_id = 0e6b92db-8296-4ff8-8725-eca53d1589a7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13532024-11-07T00:00:19.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39393
13542024-11-07T00:00:19.059ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
13552024-11-07T00:00:19.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13562024-11-07T00:00:19.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13572024-11-07T00:00:19.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13582024-11-07T00:00:19.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13592024-11-07T00:00:19.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13602024-11-07T00:00:19.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
13612024-11-07T00:00:19.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39393 req_id = 3ace37fd-681f-458f-8ea3-f1fd2e3bc6a5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13622024-11-07T00:00:26.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58421
13632024-11-07T00:00:26.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 547 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58421 req_id = 8491ccbf-b064-4d95-9db0-43d91936942d response_code = 200 uri = /vpc-routes
13642024-11-07T00:00:26.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
13652024-11-07T00:00:26.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58421 req_id = 8d0145ec-651c-47c3-b7bf-8929535e80d6 response_code = 204 uri = /eip-gateways
13662024-11-07T00:00:26.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58421 req_id = 216517b6-1339-455c-b2d0-630450e8fa46 response_code = 204 uri = /vpc-routes
13672024-11-07T00:00:27.523ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51537
13682024-11-07T00:00:27.524ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51537 req_id = affe9c4d-e18a-45f5-aad1-a8a4825eaa24 response_code = 200 uri = /baseboard
13692024-11-07T00:00:42.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64743
13702024-11-07T00:00:42.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64743 req_id = 019c844e-ab7d-47ed-8c17-3efeb8102f4c response_code = 200 uri = /v2p
13712024-11-07T00:00:42.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43867
13722024-11-07T00:00:42.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43867 req_id = 9840e928-8acd-4a7e-a100-a181866145ac response_code = 200 uri = /vpc-routes
13732024-11-07T00:00:42.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
13742024-11-07T00:00:42.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43867 req_id = d5d12420-65d6-4266-931f-1fd9f38dce02 response_code = 204 uri = /eip-gateways
13752024-11-07T00:00:42.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43867 req_id = e1844b5a-9c0f-45a8-8eed-01b608b1ee2d response_code = 204 uri = /vpc-routes
13762024-11-07T00:00:42.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46622
13772024-11-07T00:00:42.977ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
13782024-11-07T00:00:43.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
13792024-11-07T00:00:43.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147328 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46622 req_id = d26eb4c0-bef1-4923-b0c7-538d17587a50 response_code = 204 uri = /switch-ports
13802024-11-07T00:00:43.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46622 req_id = 70c15456-1a25-4eba-8f6a-21c278d5b7cf response_code = 200 uri = /network-bootstore-config
13812024-11-07T00:00:43.179ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
13822024-11-07T00:00:43.179ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4570c3a5-1712-4889-a368-30df2852f980/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
13832024-11-07T00:00:43.180ZINFOSledAgent (bootstore): Writing ledger to /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
13842024-11-07T00:00:43.181ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
13852024-11-07T00:00:43.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2853 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46622 req_id = 3b391341-9319-4480-abdc-eb214833cfab response_code = 204 uri = /network-bootstore-config
13862024-11-07T00:00:43.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50321
13872024-11-07T00:00:43.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50321 req_id = 8281f117-e963-444a-bf2d-b2869e1374d7 response_code = 200 uri = /vpc-routes
13882024-11-07T00:00:43.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51009
13892024-11-07T00:00:43.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51009 req_id = 2727864f-ac44-4502-9d0f-cb51fc25361d response_code = 200 uri = /v2p
13902024-11-07T00:00:43.692ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
13912024-11-07T00:00:43.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50321 req_id = ef053568-1eb5-4163-b78a-211cd51d1dd9 response_code = 204 uri = /eip-gateways
13922024-11-07T00:00:43.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50321 req_id = aa965e81-15d1-464c-b70a-4762a294f7d3 response_code = 204 uri = /vpc-routes
13932024-11-07T00:00:43.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44349
13942024-11-07T00:00:43.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
13952024-11-07T00:00:43.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
13962024-11-07T00:00:43.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44349 req_id = a1714e13-faf5-4c47-809a-638f481542d5 response_code = 204 uri = /switch-ports
13972024-11-07T00:00:43.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44349 req_id = 522c9ada-35d2-414f-9697-6cb71e264943 response_code = 200 uri = /network-bootstore-config
13982024-11-07T00:00:44.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65049
13992024-11-07T00:00:44.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65049 req_id = 64cd5c25-e9d0-4869-8210-146263a0b23c response_code = 200 uri = /vpc-routes
14002024-11-07T00:00:44.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14012024-11-07T00:00:44.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65049 req_id = c9a1beac-e05c-4d16-ba51-325bf022ac91 response_code = 204 uri = /eip-gateways
14022024-11-07T00:00:44.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65049 req_id = db5fc455-1ffe-4265-b8da-67bb710a692d response_code = 204 uri = /vpc-routes
14032024-11-07T00:00:44.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33004
14042024-11-07T00:00:44.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33004 req_id = 7ddbd509-4728-49d4-8220-4d101aa8f2f7 response_code = 200 uri = /v2p
14052024-11-07T00:00:44.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61068
14062024-11-07T00:00:44.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14072024-11-07T00:00:44.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14082024-11-07T00:00:44.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61068 req_id = e428222e-18f8-446f-ab02-be0287ab4813 response_code = 204 uri = /switch-ports
14092024-11-07T00:00:44.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61068 req_id = 9009d19d-e577-4a62-8dd1-19bc4a6147d3 response_code = 200 uri = /network-bootstore-config
14102024-11-07T00:00:57.556ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64564
14112024-11-07T00:00:57.556ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64564 req_id = 2c9d30c9-b6d6-4e71-8ca9-a1d5d49d5a37 response_code = 200 uri = /baseboard
14122024-11-07T00:01:12.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33629
14132024-11-07T00:01:12.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33629 req_id = 5fb21c04-de1d-443e-b0e2-7ae00733d2f8 response_code = 200 uri = /vpc-routes
14142024-11-07T00:01:12.579ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14152024-11-07T00:01:12.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33629 req_id = 20b7b391-2b6c-402f-a397-8cda28eaaab5 response_code = 204 uri = /eip-gateways
14162024-11-07T00:01:12.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33629 req_id = 7e46301c-b6cb-4e02-95c9-a162afb6e1f8 response_code = 204 uri = /vpc-routes
14172024-11-07T00:01:12.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63326
14182024-11-07T00:01:12.672ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14192024-11-07T00:01:12.709ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14202024-11-07T00:01:12.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93419 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63326 req_id = ded5e204-1312-4c6a-bd39-1bc57199a319 response_code = 204 uri = /switch-ports
14212024-11-07T00:01:12.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56760
14222024-11-07T00:01:12.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56760 req_id = 5ca69566-f168-4380-9a9e-b0c9b24ca6da response_code = 200 uri = /v2p
14232024-11-07T00:01:12.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63326 req_id = c1df2a70-2a72-4cfd-ac3f-3009c00f8f43 response_code = 200 uri = /network-bootstore-config
14242024-11-07T00:01:13.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56025
14252024-11-07T00:01:13.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56025 req_id = a18148bc-e046-4c59-aca9-7ef0dad1169f response_code = 200 uri = /vpc-routes
14262024-11-07T00:01:13.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14272024-11-07T00:01:13.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56025 req_id = 5a7d0de7-8de9-4637-aa7b-95ec732c1bda response_code = 204 uri = /eip-gateways
14282024-11-07T00:01:13.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34091
14292024-11-07T00:01:13.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34091 req_id = c805580a-3a5e-48e1-85a5-f23a64ed38c0 response_code = 200 uri = /v2p
14302024-11-07T00:01:13.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56025 req_id = ea966659-18c7-4ce0-b18b-c6bebc8cab1f response_code = 204 uri = /vpc-routes
14312024-11-07T00:01:13.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60444
14322024-11-07T00:01:13.610ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14332024-11-07T00:01:13.646ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14342024-11-07T00:01:13.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60444 req_id = 12065b0e-152d-4bef-a676-c5632134fd8a response_code = 204 uri = /switch-ports
14352024-11-07T00:01:13.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60444 req_id = 68d00ece-525e-4a3f-bf45-3d9f9b4cb95f response_code = 200 uri = /network-bootstore-config
14362024-11-07T00:01:14.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50500
14372024-11-07T00:01:14.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50500 req_id = 654222a3-9dbb-4fee-a4f5-ccd7935239f6 response_code = 200 uri = /vpc-routes
14382024-11-07T00:01:14.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14392024-11-07T00:01:14.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50500 req_id = 7786f11f-7347-46df-bead-bbe23f883811 response_code = 204 uri = /eip-gateways
14402024-11-07T00:01:14.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50500 req_id = 8c8da2f9-9a30-4f38-a86f-aba11ea1f693 response_code = 204 uri = /vpc-routes
14412024-11-07T00:01:14.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34354
14422024-11-07T00:01:14.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34354 req_id = c467491f-2542-4ad7-a34d-66db02fbc90e response_code = 200 uri = /v2p
14432024-11-07T00:01:14.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61226
14442024-11-07T00:01:14.227ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14452024-11-07T00:01:14.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14462024-11-07T00:01:14.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61226 req_id = 1c6aafcd-a5b4-4af8-9594-0606997359a6 response_code = 204 uri = /switch-ports
14472024-11-07T00:01:14.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61226 req_id = 592a5189-e76c-4c80-ba8b-ef09f514e128 response_code = 200 uri = /network-bootstore-config
14482024-11-07T00:01:27.594ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43922
14492024-11-07T00:01:27.594ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43922 req_id = 57c6621e-ef09-4144-9d8f-0fb543eb314a response_code = 200 uri = /baseboard
14502024-11-07T00:01:42.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56396
14512024-11-07T00:01:42.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56396 req_id = 029f668d-a804-4cbf-8916-5409e91f1239 response_code = 200 uri = /vpc-routes
14522024-11-07T00:01:42.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14532024-11-07T00:01:42.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56396 req_id = 98d52b63-1bfd-42fc-9ca6-e6149106947e response_code = 204 uri = /eip-gateways
14542024-11-07T00:01:42.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56396 req_id = adb34e52-f384-43f0-a7e8-eaa04834f4f2 response_code = 204 uri = /vpc-routes
14552024-11-07T00:01:42.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50387
14562024-11-07T00:01:42.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50387 req_id = f33a79c5-db14-407c-8fc6-04a2bcdcc836 response_code = 200 uri = /v2p
14572024-11-07T00:01:43.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37963
14582024-11-07T00:01:43.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14592024-11-07T00:01:43.057ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14602024-11-07T00:01:43.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37963 req_id = ef2f44b1-e172-494d-8c9f-0de7bc233a89 response_code = 204 uri = /switch-ports
14612024-11-07T00:01:43.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37963 req_id = fa5adf1e-924d-4547-a341-39c6ecf86d0b response_code = 200 uri = /network-bootstore-config
14622024-11-07T00:01:43.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52663
14632024-11-07T00:01:43.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52663 req_id = bd90457a-0e92-400c-9884-55cec79da268 response_code = 200 uri = /v2p
14642024-11-07T00:01:43.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63535
14652024-11-07T00:01:43.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63535 req_id = 82a37cdd-53d3-49b5-98cc-6369891d0486 response_code = 200 uri = /vpc-routes
14662024-11-07T00:01:43.731ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14672024-11-07T00:01:43.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63535 req_id = 0cbadc78-a060-495f-b629-945d68888a2a response_code = 204 uri = /eip-gateways
14682024-11-07T00:01:43.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63535 req_id = f36f859e-499c-4953-9c6d-cee2c051fc35 response_code = 204 uri = /vpc-routes
14692024-11-07T00:01:43.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51271
14702024-11-07T00:01:43.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14712024-11-07T00:01:43.960ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14722024-11-07T00:01:44.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113702 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51271 req_id = 930dd74a-8831-4cb6-bcb4-56106cd32b52 response_code = 204 uri = /switch-ports
14732024-11-07T00:01:44.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51271 req_id = 56695f13-8896-4f99-ba45-38bb54044bb5 response_code = 200 uri = /network-bootstore-config
14742024-11-07T00:01:44.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54574
14752024-11-07T00:01:44.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54574 req_id = 263a5868-eec6-4792-8540-36f6f8be0956 response_code = 200 uri = /vpc-routes
14762024-11-07T00:01:44.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35039
14772024-11-07T00:01:44.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35039 req_id = 425f3fa6-74b6-4933-af67-0a8bcc8bf41e response_code = 200 uri = /v2p
14782024-11-07T00:01:44.416ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14792024-11-07T00:01:44.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54574 req_id = f3931c16-c679-4014-9b66-f5153b5535c5 response_code = 204 uri = /eip-gateways
14802024-11-07T00:01:44.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54574 req_id = 0b281cea-d139-4184-a07b-a43557e3ffe6 response_code = 204 uri = /vpc-routes
14812024-11-07T00:01:44.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57971
14822024-11-07T00:01:44.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14832024-11-07T00:01:44.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14842024-11-07T00:01:44.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57971 req_id = 57d8f1fd-644e-4b4f-8b76-ec1ea9a2b008 response_code = 204 uri = /switch-ports
14852024-11-07T00:01:44.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57971 req_id = 37eb7e1b-a1d5-4ae0-984f-6df64d95a23b response_code = 200 uri = /network-bootstore-config
14862024-11-07T00:01:57.627ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33622
14872024-11-07T00:01:57.628ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33622 req_id = e54a01fc-1073-42b4-9b93-e37b9ee3fb7c response_code = 200 uri = /baseboard
14882024-11-07T00:02:12.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61773
14892024-11-07T00:02:12.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61773 req_id = 64d883ba-0729-44ff-9a83-720a9b6b0620 response_code = 200 uri = /v2p
14902024-11-07T00:02:12.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63646
14912024-11-07T00:02:12.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63646 req_id = 359e093e-5d85-4723-960e-29f07b09afa3 response_code = 200 uri = /vpc-routes
14922024-11-07T00:02:12.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
14932024-11-07T00:02:12.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63646 req_id = 1bbe2520-382c-4030-9991-66770c77f370 response_code = 204 uri = /eip-gateways
14942024-11-07T00:02:12.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63646 req_id = 4efc7c0d-a6a5-4fa1-a678-c68f9861dd86 response_code = 204 uri = /vpc-routes
14952024-11-07T00:02:12.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44415
14962024-11-07T00:02:12.679ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
14972024-11-07T00:02:12.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
14982024-11-07T00:02:12.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44415 req_id = 14bd3922-10a7-46b5-a0e8-2454c75a47ab response_code = 204 uri = /switch-ports
14992024-11-07T00:02:12.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44415 req_id = d54dc191-c08d-4a4b-89c0-cfea28f722b5 response_code = 200 uri = /network-bootstore-config
15002024-11-07T00:02:13.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54928
15012024-11-07T00:02:13.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54928 req_id = 8d78095c-0acd-48e1-be5b-201bc5940b0c response_code = 200 uri = /vpc-routes
15022024-11-07T00:02:13.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60756
15032024-11-07T00:02:13.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60756 req_id = d39b2878-e8c2-4d02-8d1f-3a0c7b8bdea3 response_code = 200 uri = /v2p
15042024-11-07T00:02:13.500ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15052024-11-07T00:02:13.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54928 req_id = 73d42bf7-221c-4978-9e52-fd7d44518238 response_code = 204 uri = /eip-gateways
15062024-11-07T00:02:13.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54928 req_id = 34b471ac-92cb-4b76-8e7c-7b07d638ddfa response_code = 204 uri = /vpc-routes
15072024-11-07T00:02:13.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42330
15082024-11-07T00:02:13.545ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15092024-11-07T00:02:13.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15102024-11-07T00:02:13.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93066 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42330 req_id = a3f1b099-fbf4-48fe-89e9-3111f2774836 response_code = 204 uri = /switch-ports
15112024-11-07T00:02:13.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42330 req_id = 9ba89916-aa92-47e9-8a8e-ea82b2732bbb response_code = 200 uri = /network-bootstore-config
15122024-11-07T00:02:14.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49755
15132024-11-07T00:02:14.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49755 req_id = a2f6c32a-0694-452e-96d6-7e7454b0622f response_code = 200 uri = /vpc-routes
15142024-11-07T00:02:14.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15152024-11-07T00:02:14.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49755 req_id = 418883c4-6712-4727-937e-e0bbe8f77496 response_code = 204 uri = /eip-gateways
15162024-11-07T00:02:14.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49755 req_id = 53159abd-74c2-4422-84da-af4a828cf331 response_code = 204 uri = /vpc-routes
15172024-11-07T00:02:14.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32866
15182024-11-07T00:02:14.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32866 req_id = ca132a32-cf5d-46d1-8f08-d2e37a073a9e response_code = 200 uri = /v2p
15192024-11-07T00:02:14.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49991
15202024-11-07T00:02:14.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15212024-11-07T00:02:14.216ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15222024-11-07T00:02:14.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49991 req_id = 0888d6a7-aa4f-4933-bbd8-fb8ac75ed925 response_code = 204 uri = /switch-ports
15232024-11-07T00:02:14.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49991 req_id = 940385d5-640c-481b-8d43-e02738754575 response_code = 200 uri = /network-bootstore-config
15242024-11-07T00:02:27.661ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41612
15252024-11-07T00:02:27.661ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41612 req_id = 71939d02-f145-4e6b-aeac-42d345de01a1 response_code = 200 uri = /baseboard
15262024-11-07T00:02:42.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65079
15272024-11-07T00:02:42.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65079 req_id = 64d0d6ab-09c8-4938-a438-a049a426ad69 response_code = 200 uri = /vpc-routes
15282024-11-07T00:02:42.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15292024-11-07T00:02:42.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65079 req_id = 65ada88c-e9f9-44f4-8e9a-9166abe053b3 response_code = 204 uri = /eip-gateways
15302024-11-07T00:02:42.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65079 req_id = 58f75096-c105-4b9f-a545-b596c0f4bc12 response_code = 204 uri = /vpc-routes
15312024-11-07T00:02:43.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36057
15322024-11-07T00:02:43.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36057 req_id = c0f1b126-97e7-47f2-98d7-55a995b35635 response_code = 200 uri = /v2p
15332024-11-07T00:02:43.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39040
15342024-11-07T00:02:43.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15352024-11-07T00:02:43.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15362024-11-07T00:02:43.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39040 req_id = de5cb2d1-9d4c-47a6-b9f6-637e623c0bc9 response_code = 204 uri = /switch-ports
15372024-11-07T00:02:43.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39040 req_id = 02736371-2858-4f4f-950d-ce9138c3159b response_code = 200 uri = /network-bootstore-config
15382024-11-07T00:02:43.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35806
15392024-11-07T00:02:43.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35806 req_id = a078b7c3-2822-4092-9c75-e3776f7f372a response_code = 200 uri = /v2p
15402024-11-07T00:02:43.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48390
15412024-11-07T00:02:43.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48390 req_id = da38ed2b-ce1d-4772-a2dc-7357b0e16f92 response_code = 200 uri = /vpc-routes
15422024-11-07T00:02:43.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15432024-11-07T00:02:43.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48390 req_id = a13d200e-fc5d-444f-a99f-8052d1182b4d response_code = 204 uri = /eip-gateways
15442024-11-07T00:02:43.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48390 req_id = b30ab2a7-8119-4e7d-9d97-ce220429b523 response_code = 204 uri = /vpc-routes
15452024-11-07T00:02:43.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36052
15462024-11-07T00:02:43.823ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15472024-11-07T00:02:43.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15482024-11-07T00:02:43.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36052 req_id = 91d23dd5-82a0-44ad-8702-2dc113022f28 response_code = 204 uri = /switch-ports
15492024-11-07T00:02:43.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36052 req_id = 2caa2051-684c-41c7-8c20-c01a3f7946b9 response_code = 200 uri = /network-bootstore-config
15502024-11-07T00:02:44.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35173
15512024-11-07T00:02:44.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35173 req_id = 3ed3b06e-535e-427d-9ff3-ff50b3aa68a7 response_code = 200 uri = /v2p
15522024-11-07T00:02:44.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50488
15532024-11-07T00:02:44.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50488 req_id = ce658c44-62d3-46dd-a46a-963fefd8acef response_code = 200 uri = /vpc-routes
15542024-11-07T00:02:44.406ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15552024-11-07T00:02:44.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50488 req_id = 24944b06-ff8a-498a-8c33-d80c85f6de61 response_code = 204 uri = /eip-gateways
15562024-11-07T00:02:44.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50488 req_id = fcc460b4-42bc-47e8-b1e9-9a787af0f5aa response_code = 204 uri = /vpc-routes
15572024-11-07T00:02:44.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51774
15582024-11-07T00:02:44.438ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15592024-11-07T00:02:44.477ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15602024-11-07T00:02:44.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96106 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51774 req_id = 2f1f7aac-3ae7-49b9-9b35-3347823977eb response_code = 204 uri = /switch-ports
15612024-11-07T00:02:44.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51774 req_id = 306b0282-99dc-4755-ad39-6327b73a16a0 response_code = 200 uri = /network-bootstore-config
15622024-11-07T00:02:49.006ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
15632024-11-07T00:02:57.698ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33335
15642024-11-07T00:02:57.698ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33335 req_id = eb12bbb9-ca9b-40cc-b96e-90c697470e72 response_code = 200 uri = /baseboard
15652024-11-07T00:03:12.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35770
15662024-11-07T00:03:12.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35770 req_id = 6e8baa1b-6721-4fb7-b371-e534ea2d42e6 response_code = 200 uri = /vpc-routes
15672024-11-07T00:03:12.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15682024-11-07T00:03:12.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35770 req_id = ecd66927-5ba9-4407-a9a4-529f46873383 response_code = 204 uri = /eip-gateways
15692024-11-07T00:03:12.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35770 req_id = 1fbce31b-c709-4895-9f29-2bef3e26c43a response_code = 204 uri = /vpc-routes
15702024-11-07T00:03:12.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64416
15712024-11-07T00:03:12.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15722024-11-07T00:03:12.808ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15732024-11-07T00:03:12.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99896 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64416 req_id = e1b257b9-193d-40b6-831d-0815dd8915be response_code = 204 uri = /switch-ports
15742024-11-07T00:03:12.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64416 req_id = 95c620d1-742e-40ff-9270-c392b4a4e626 response_code = 200 uri = /network-bootstore-config
15752024-11-07T00:03:12.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46107
15762024-11-07T00:03:12.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46107 req_id = 42bb1257-38f0-451c-a255-ae5dac8e8510 response_code = 200 uri = /v2p
15772024-11-07T00:03:13.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42567
15782024-11-07T00:03:13.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42567 req_id = e0c22340-5026-4c98-ae69-efda6907fcfc response_code = 200 uri = /vpc-routes
15792024-11-07T00:03:13.481ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15802024-11-07T00:03:13.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42567 req_id = 284765ac-e859-418d-9dbb-14d0f0284d2c response_code = 204 uri = /eip-gateways
15812024-11-07T00:03:13.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42567 req_id = 6d491bb7-b2f3-4f93-9eb4-6bd1269e5905 response_code = 204 uri = /vpc-routes
15822024-11-07T00:03:13.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62751
15832024-11-07T00:03:13.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62751 req_id = 2ca29597-f0f3-4461-abc3-cf79c028f24b response_code = 200 uri = /v2p
15842024-11-07T00:03:13.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41026
15852024-11-07T00:03:13.561ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15862024-11-07T00:03:13.600ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15872024-11-07T00:03:13.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96567 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41026 req_id = fdee3044-525f-4695-a90a-4453e496f870 response_code = 204 uri = /switch-ports
15882024-11-07T00:03:13.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41026 req_id = c1234b25-f9f1-4e70-91d7-918afe4337f4 response_code = 200 uri = /network-bootstore-config
15892024-11-07T00:03:14.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60660
15902024-11-07T00:03:14.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60660 req_id = 25ee822f-9695-4ec8-a972-ae99bedf74fe response_code = 200 uri = /v2p
15912024-11-07T00:03:14.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52570
15922024-11-07T00:03:14.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52570 req_id = 3dcda025-a525-475b-bb31-2c11ffeceb63 response_code = 200 uri = /vpc-routes
15932024-11-07T00:03:14.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
15942024-11-07T00:03:14.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52570 req_id = d4c85da3-40dc-491a-9ae1-b43ef505e1d0 response_code = 204 uri = /eip-gateways
15952024-11-07T00:03:14.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52570 req_id = a317d022-4637-4a84-a766-0ac0e7989783 response_code = 204 uri = /vpc-routes
15962024-11-07T00:03:14.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60403
15972024-11-07T00:03:14.202ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15982024-11-07T00:03:14.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15992024-11-07T00:03:14.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60403 req_id = 9e323e3a-d878-4299-a50a-c8961e65b694 response_code = 204 uri = /switch-ports
16002024-11-07T00:03:14.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60403 req_id = cd0652a3-5d03-4407-8117-2efc5d046909 response_code = 200 uri = /network-bootstore-config
16012024-11-07T00:03:27.730ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41812
16022024-11-07T00:03:27.731ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41812 req_id = 46fe778a-13b2-4ce6-80ff-7decb677cd20 response_code = 200 uri = /baseboard
16032024-11-07T00:03:42.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62468
16042024-11-07T00:03:42.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62468 req_id = 6118fec0-9aa9-436b-b64f-833bb03d5a68 response_code = 200 uri = /vpc-routes
16052024-11-07T00:03:42.781ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
16062024-11-07T00:03:42.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62468 req_id = bf4ad97c-8e00-4131-b7c0-fd2dd098075d response_code = 204 uri = /eip-gateways
16072024-11-07T00:03:42.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62468 req_id = 42ed359e-60f8-4b4b-b567-f2b349b62e89 response_code = 204 uri = /vpc-routes
16082024-11-07T00:03:42.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39172
16092024-11-07T00:03:42.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39172 req_id = 0fc4e5db-2777-4c8b-a3b6-8ae7ff4492cb response_code = 200 uri = /v2p
16102024-11-07T00:03:42.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44281
16112024-11-07T00:03:42.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16122024-11-07T00:03:43.020ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16132024-11-07T00:03:43.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91998 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44281 req_id = a017a929-113a-4821-93e4-13b1f8160e4f response_code = 204 uri = /switch-ports
16142024-11-07T00:03:43.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44281 req_id = 672eee48-30ef-439d-ad04-291cdee170ea response_code = 200 uri = /network-bootstore-config
16152024-11-07T00:03:43.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57575
16162024-11-07T00:03:43.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57575 req_id = 8bfb5620-47fb-4f07-8c3b-1d9d82ef0d30 response_code = 200 uri = /vpc-routes
16172024-11-07T00:03:43.633ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
16182024-11-07T00:03:43.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57575 req_id = 0ad4a829-7788-476d-b73c-ce877bef5731 response_code = 204 uri = /eip-gateways
16192024-11-07T00:03:43.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57575 req_id = be44df28-d036-40b0-91d2-8c4d8f0b88da response_code = 204 uri = /vpc-routes
16202024-11-07T00:03:43.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33452
16212024-11-07T00:03:43.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33452 req_id = 3a868798-344a-475f-a117-d75bc10ac26e response_code = 200 uri = /v2p
16222024-11-07T00:03:43.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48247
16232024-11-07T00:03:43.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16242024-11-07T00:03:44.025ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16252024-11-07T00:03:44.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93143 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48247 req_id = 0fed1849-181f-4e1f-a16c-c4f4b2ff839a response_code = 204 uri = /switch-ports
16262024-11-07T00:03:44.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48247 req_id = 9aa0a071-9926-4d05-8e80-3dc3fe70e9c6 response_code = 200 uri = /network-bootstore-config
16272024-11-07T00:03:44.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51789
16282024-11-07T00:03:44.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51789 req_id = d5e21c58-d5b4-4caf-af31-27d52e93b0df response_code = 200 uri = /vpc-routes
16292024-11-07T00:03:44.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
16302024-11-07T00:03:44.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51789 req_id = cc485488-cb32-4d93-a92c-b58ccb2c7ae5 response_code = 204 uri = /eip-gateways
16312024-11-07T00:03:44.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51789 req_id = 16314121-44c8-47f7-9ae8-9ab90ffeb25b response_code = 204 uri = /vpc-routes
16322024-11-07T00:03:44.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37754
16332024-11-07T00:03:44.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16342024-11-07T00:03:44.368ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16352024-11-07T00:03:44.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37754 req_id = bfcddfb9-822c-4ec4-8405-6cdb0d67181a response_code = 204 uri = /switch-ports
16362024-11-07T00:03:44.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63775
16372024-11-07T00:03:44.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37754 req_id = 754d253a-a9b9-4859-8ef5-cb4d2ffa8ef0 response_code = 200 uri = /network-bootstore-config
16382024-11-07T00:03:44.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63775 req_id = ea6fe695-060c-4aff-b99d-fa20da7072e6 response_code = 200 uri = /v2p
16392024-11-07T00:03:57.764ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53859
16402024-11-07T00:03:57.764ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53859 req_id = 8469b5a6-716f-4397-a6ed-f1fd00bf14fa response_code = 200 uri = /baseboard
16412024-11-07T00:04:12.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56441
16422024-11-07T00:04:12.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56441 req_id = 6498e9d7-26f5-472d-af48-0304e7cc9265 response_code = 200 uri = /vpc-routes
16432024-11-07T00:04:12.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
16442024-11-07T00:04:12.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56441 req_id = 9a995557-d8d4-4ebe-8748-60fd668070be response_code = 204 uri = /eip-gateways
16452024-11-07T00:04:12.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51763
16462024-11-07T00:04:12.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51763 req_id = 9a448cfe-1b47-4cb0-bfae-cfaa6ec3ae36 response_code = 200 uri = /v2p
16472024-11-07T00:04:12.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56441 req_id = 83871d82-43f4-4f90-b8e0-eba325a37db9 response_code = 204 uri = /vpc-routes
16482024-11-07T00:04:12.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39851
16492024-11-07T00:04:12.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16502024-11-07T00:04:12.766ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16512024-11-07T00:04:12.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39851 req_id = 628d9beb-942d-4e30-81da-afe5ff535a92 response_code = 204 uri = /switch-ports
16522024-11-07T00:04:12.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39851 req_id = b94858a8-2bfd-487f-b313-0a97e798dfba response_code = 200 uri = /network-bootstore-config
16532024-11-07T00:04:13.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38524
16542024-11-07T00:04:13.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38524 req_id = f1e9da91-6bea-4f5e-baf3-35f7249c738e response_code = 200 uri = /vpc-routes
16552024-11-07T00:04:13.416ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
16562024-11-07T00:04:13.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38524 req_id = 7a246157-81a3-43f2-bbd2-8d6c32e39599 response_code = 204 uri = /eip-gateways
16572024-11-07T00:04:13.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38524 req_id = 7e7da079-8070-4093-8553-e87b7ebd3f97 response_code = 204 uri = /vpc-routes
16582024-11-07T00:04:13.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59492
16592024-11-07T00:04:13.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59492 req_id = cbe03b14-343a-4d60-94e9-565d827be305 response_code = 200 uri = /v2p
16602024-11-07T00:04:13.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34678
16612024-11-07T00:04:13.567ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16622024-11-07T00:04:13.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16632024-11-07T00:04:13.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34678 req_id = b835b76a-19fa-4f20-b9b7-e6e0ad42a70e response_code = 204 uri = /switch-ports
16642024-11-07T00:04:13.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34678 req_id = dbb9b7f4-5c6e-4892-af69-ff877547666a response_code = 200 uri = /network-bootstore-config
16652024-11-07T00:04:13.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65195
16662024-11-07T00:04:13.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65195 req_id = b4cf4256-6ab8-4e15-b50e-010485a1cda5 response_code = 200 uri = /vpc-routes
16672024-11-07T00:04:14.010ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
16682024-11-07T00:04:14.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65195 req_id = 22c91182-ae74-40f3-a49e-22a78f51b397 response_code = 204 uri = /eip-gateways
16692024-11-07T00:04:14.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65195 req_id = 49a103ef-284a-4e57-8c89-2f71cb0cdd5e response_code = 204 uri = /vpc-routes
16702024-11-07T00:04:14.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59011
16712024-11-07T00:04:14.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59011 req_id = 7a2e9ae8-2aa0-436c-9f7e-2378871ffeea response_code = 200 uri = /v2p
16722024-11-07T00:04:14.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60350
16732024-11-07T00:04:14.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16742024-11-07T00:04:14.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16752024-11-07T00:04:14.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60350 req_id = c746a861-6839-49cd-802c-12f9300a1d80 response_code = 204 uri = /switch-ports
16762024-11-07T00:04:14.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60350 req_id = 2469edb2-5b1f-44fd-ae0e-179555f9b5a8 response_code = 200 uri = /network-bootstore-config
16772024-11-07T00:04:27.799ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33207
16782024-11-07T00:04:27.799ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33207 req_id = 1f6ee41d-d40b-44da-8559-661c5c56a382 response_code = 200 uri = /baseboard
16792024-11-07T00:04:42.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61249
16802024-11-07T00:04:42.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61249 req_id = 68b2acc1-a85f-42cd-afb1-d7fba9c0d49c response_code = 200 uri = /vpc-routes
16812024-11-07T00:04:42.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
16822024-11-07T00:04:42.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61249 req_id = a66ce588-aabd-44cc-ac77-63d68b83c441 response_code = 204 uri = /eip-gateways
16832024-11-07T00:04:42.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61249 req_id = 0bbcc344-d89a-4843-8a0b-a91429211bad response_code = 204 uri = /vpc-routes
16842024-11-07T00:04:42.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37208
16852024-11-07T00:04:42.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37208 req_id = aa71c3b3-0835-4f3e-8937-fdfee81c0b82 response_code = 200 uri = /v2p
16862024-11-07T00:04:42.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56753
16872024-11-07T00:04:42.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16882024-11-07T00:04:42.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16892024-11-07T00:04:42.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96968 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56753 req_id = ddda89c1-8d05-4f4e-9b9a-7dfc66f252a2 response_code = 204 uri = /switch-ports
16902024-11-07T00:04:42.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49212
16912024-11-07T00:04:42.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56753 req_id = f85850b6-0f3b-4c6a-8d2e-380e1f6857e2 response_code = 200 uri = /network-bootstore-config
16922024-11-07T00:04:42.969ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16932024-11-07T00:04:42.969ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16942024-11-07T00:04:42.969ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16952024-11-07T00:04:42.969ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962024-11-07T00:04:42.969ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16972024-11-07T00:04:42.970ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16982024-11-07T00:04:42.970ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16992024-11-07T00:04:42.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49212 req_id = 8eff17de-59cd-4521-af52-ecc0e0de11cd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17002024-11-07T00:04:43.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43189
17012024-11-07T00:04:43.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43189 req_id = 013a9ab0-45c8-4f2c-99bc-57cdd18825e8 response_code = 200 uri = /vpc-routes
17022024-11-07T00:04:43.723ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
17032024-11-07T00:04:43.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43189 req_id = b079f0d7-372f-4388-b131-9527e85cdfa9 response_code = 204 uri = /eip-gateways
17042024-11-07T00:04:43.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43189 req_id = 7db65ed9-dfc3-4782-97a4-7ff35b252368 response_code = 204 uri = /vpc-routes
17052024-11-07T00:04:43.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54296
17062024-11-07T00:04:43.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54296 req_id = ee167d6d-f763-444d-93aa-a653c91613fc response_code = 200 uri = /v2p
17072024-11-07T00:04:43.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43038
17082024-11-07T00:04:43.905ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17092024-11-07T00:04:43.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17102024-11-07T00:04:44.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43038 req_id = f30696d8-4934-4178-ae5f-ca72ece4f8b1 response_code = 204 uri = /switch-ports
17112024-11-07T00:04:44.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36647
17122024-11-07T00:04:44.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43038 req_id = df60f1ef-9ef9-4acf-ae53-12df1feaf923 response_code = 200 uri = /network-bootstore-config
17132024-11-07T00:04:44.020ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17142024-11-07T00:04:44.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17152024-11-07T00:04:44.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17162024-11-07T00:04:44.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172024-11-07T00:04:44.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17182024-11-07T00:04:44.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17192024-11-07T00:04:44.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17202024-11-07T00:04:44.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36647 req_id = d27eb2b0-1b87-4a97-ba47-c43c44881b38 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17212024-11-07T00:04:44.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53336
17222024-11-07T00:04:44.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53336 req_id = 85611095-fcc4-4142-ab4e-e445f5fc4fa2 response_code = 200 uri = /vpc-routes
17232024-11-07T00:04:44.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35810
17242024-11-07T00:04:44.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35810 req_id = ee76c109-8ead-447f-ab16-847939f25e3b response_code = 200 uri = /v2p
17252024-11-07T00:04:44.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34920
17262024-11-07T00:04:44.433ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17272024-11-07T00:04:44.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17282024-11-07T00:04:44.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34920 req_id = c8c6e120-fdcd-4d95-a1e8-6659d74f1b11 response_code = 204 uri = /switch-ports
17292024-11-07T00:04:44.538ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
17302024-11-07T00:04:44.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53336 req_id = 1ea8622a-046f-4638-bcc1-34b2702185aa response_code = 204 uri = /eip-gateways
17312024-11-07T00:04:44.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34920 req_id = d1a44ec9-42eb-4bf7-88a5-e76a49efb00a response_code = 200 uri = /network-bootstore-config
17322024-11-07T00:04:44.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53336 req_id = 3f72e676-0c25-4232-b81b-58b8bb7bd97a response_code = 204 uri = /vpc-routes
17332024-11-07T00:04:44.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64963
17342024-11-07T00:04:44.685ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17352024-11-07T00:04:44.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17362024-11-07T00:04:44.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17372024-11-07T00:04:44.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17382024-11-07T00:04:44.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17392024-11-07T00:04:44.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17402024-11-07T00:04:44.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17412024-11-07T00:04:44.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64963 req_id = 90e46f7f-7212-4bd7-b5c9-2c354dbabc07 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17422024-11-07T00:04:57.833ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51730
17432024-11-07T00:04:57.833ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51730 req_id = ed829b5e-4908-4a79-aca1-f16c01994cdb response_code = 200 uri = /baseboard
17442024-11-07T00:05:12.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60330
17452024-11-07T00:05:12.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60330 req_id = 18d0689b-549e-420e-83c6-b91201f92bb7 response_code = 200 uri = /vpc-routes
17462024-11-07T00:05:12.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
17472024-11-07T00:05:12.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60330 req_id = 486bb224-6e57-435a-8e3b-e1c1f9b8870c response_code = 204 uri = /eip-gateways
17482024-11-07T00:05:12.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60330 req_id = c37e70e8-29dc-40d8-b57e-6f5d214f75f8 response_code = 204 uri = /vpc-routes
17492024-11-07T00:05:12.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48039
17502024-11-07T00:05:12.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48039 req_id = 29103b53-5584-4fe3-a015-fd5939ec4581 response_code = 200 uri = /v2p
17512024-11-07T00:05:12.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46748
17522024-11-07T00:05:12.706ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17532024-11-07T00:05:12.743ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17542024-11-07T00:05:12.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46748 req_id = 4cfc37e0-6adb-4b25-bbdb-457bca3f843e response_code = 204 uri = /switch-ports
17552024-11-07T00:05:12.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46748 req_id = 8e4048bd-b1b2-4b6d-943d-b84bb964731a response_code = 200 uri = /network-bootstore-config
17562024-11-07T00:05:13.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36071
17572024-11-07T00:05:13.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36071 req_id = b4147d0b-6661-4f3d-aa97-6e398801235d response_code = 200 uri = /vpc-routes
17582024-11-07T00:05:13.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
17592024-11-07T00:05:13.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36071 req_id = 461a6e54-69a4-48c5-81f7-e67bd86174c6 response_code = 204 uri = /eip-gateways
17602024-11-07T00:05:13.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60830
17612024-11-07T00:05:13.588ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17622024-11-07T00:05:13.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17632024-11-07T00:05:13.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60830 req_id = 53b8ed2d-521a-4ef2-bab0-7aca39db9316 response_code = 204 uri = /switch-ports
17642024-11-07T00:05:13.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50863
17652024-11-07T00:05:13.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60830 req_id = d351df82-42b9-4c5d-b3ed-4c1211511549 response_code = 200 uri = /network-bootstore-config
17662024-11-07T00:05:13.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36071 req_id = f7f5e9fd-135e-42a6-8e07-8174dce37de5 response_code = 204 uri = /vpc-routes
17672024-11-07T00:05:13.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50863 req_id = 9dd872ba-2409-4183-9f1a-9b9dbb911aee response_code = 200 uri = /v2p
17682024-11-07T00:05:14.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43639
17692024-11-07T00:05:14.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43639 req_id = 2c7b248d-096a-4e7c-b362-6fd781f2590a response_code = 200 uri = /vpc-routes
17702024-11-07T00:05:14.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
17712024-11-07T00:05:14.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43639 req_id = 5b48c32c-fc34-4c2b-a809-a0665be628e5 response_code = 204 uri = /eip-gateways
17722024-11-07T00:05:14.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43639 req_id = 87393b44-7954-4fb6-b55e-4cc696c49805 response_code = 204 uri = /vpc-routes
17732024-11-07T00:05:14.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63358
17742024-11-07T00:05:14.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63358 req_id = 3c05a528-2a7e-40bf-b5ed-eef7368291eb response_code = 200 uri = /v2p
17752024-11-07T00:05:14.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38339
17762024-11-07T00:05:14.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17772024-11-07T00:05:14.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17782024-11-07T00:05:14.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98524 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38339 req_id = bee4b7be-c5cd-46df-80d4-ce098db4606c response_code = 204 uri = /switch-ports
17792024-11-07T00:05:14.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 901 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38339 req_id = 00e04b9f-2669-4753-90b5-b99703829556 response_code = 200 uri = /network-bootstore-config
17802024-11-07T00:05:27.871ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60018
17812024-11-07T00:05:27.871ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60018 req_id = 29e172e3-53c2-438b-aa51-21f20ee82d15 response_code = 200 uri = /baseboard
17822024-11-07T00:05:42.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40373
17832024-11-07T00:05:42.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40373 req_id = 91f57a98-4e67-451b-9663-cf13168f5455 response_code = 200 uri = /vpc-routes
17842024-11-07T00:05:42.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42049
17852024-11-07T00:05:42.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42049 req_id = bc69fc10-4b0e-4801-811f-9f05d94f8da2 response_code = 200 uri = /v2p
17862024-11-07T00:05:42.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
17872024-11-07T00:05:42.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40373 req_id = 6088b5a8-0b57-40d5-a165-14b4e45075d3 response_code = 204 uri = /eip-gateways
17882024-11-07T00:05:42.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40373 req_id = 0d5d3f66-cdc3-491d-a4da-6b4a0654b05a response_code = 204 uri = /vpc-routes
17892024-11-07T00:05:42.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56962
17902024-11-07T00:05:42.840ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17912024-11-07T00:05:42.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17922024-11-07T00:05:42.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56962 req_id = 96d93658-3dd1-4301-85af-a65a3b2d3f53 response_code = 204 uri = /switch-ports
17932024-11-07T00:05:42.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56962 req_id = 299aeb80-69a3-4197-a6d8-b3c5c92473cd response_code = 200 uri = /network-bootstore-config
17942024-11-07T00:05:43.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58546
17952024-11-07T00:05:43.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58546 req_id = 769a12fe-de6b-45c3-9892-dd08465bb975 response_code = 200 uri = /vpc-routes
17962024-11-07T00:05:43.559ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
17972024-11-07T00:05:43.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58546 req_id = 2c5b77e9-e39d-45c0-b507-effb45684f55 response_code = 204 uri = /eip-gateways
17982024-11-07T00:05:43.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58546 req_id = 3488fa4a-3030-4038-8511-479bbc2ed14d response_code = 204 uri = /vpc-routes
17992024-11-07T00:05:43.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45281
18002024-11-07T00:05:43.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45281 req_id = 8f3a93fc-5b3c-48ff-8260-54b1dd3bcbe4 response_code = 200 uri = /v2p
18012024-11-07T00:05:43.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49096
18022024-11-07T00:05:43.693ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18032024-11-07T00:05:43.734ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18042024-11-07T00:05:43.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49096 req_id = 30a5f823-b66a-4cc2-b303-2ccc35fea5c2 response_code = 204 uri = /switch-ports
18052024-11-07T00:05:43.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49096 req_id = 2d59cb93-1ed7-43b3-8b5b-9fc1393f5532 response_code = 200 uri = /network-bootstore-config
18062024-11-07T00:05:44.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46990
18072024-11-07T00:05:44.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46990 req_id = d7c1d289-8eca-4010-8778-8f1fee828a6a response_code = 200 uri = /vpc-routes
18082024-11-07T00:05:44.311ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
18092024-11-07T00:05:44.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46990 req_id = 62eeb1c0-b207-4e5b-a5eb-96765cf56c15 response_code = 204 uri = /eip-gateways
18102024-11-07T00:05:44.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46990 req_id = 63b48c77-8c59-4558-8a5b-4163816ba545 response_code = 204 uri = /vpc-routes
18112024-11-07T00:05:44.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49546
18122024-11-07T00:05:44.395ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18132024-11-07T00:05:44.437ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18142024-11-07T00:05:44.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49546 req_id = 8444e675-9059-4c69-a3fa-77571974fd4a response_code = 204 uri = /switch-ports
18152024-11-07T00:05:44.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44101
18162024-11-07T00:05:44.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44101 req_id = 88f1ec5d-f3e1-4368-8427-fcff6d9ef43a response_code = 200 uri = /v2p
18172024-11-07T00:05:44.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49546 req_id = 821ffa42-3c5d-4d88-886e-32838347dd42 response_code = 200 uri = /network-bootstore-config
18182024-11-07T00:05:57.903ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43408
18192024-11-07T00:05:57.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43408 req_id = 48b87aab-8e90-457f-9c7e-72267db7021b response_code = 200 uri = /baseboard
18202024-11-07T00:06:12.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46671
18212024-11-07T00:06:12.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46671 req_id = afa7ea58-6a88-4284-87ca-302bbf09d2bd response_code = 200 uri = /vpc-routes
18222024-11-07T00:06:12.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
18232024-11-07T00:06:12.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46671 req_id = 4e8f46fd-7c5d-4239-9fdc-7f8af2a22d85 response_code = 204 uri = /eip-gateways
18242024-11-07T00:06:12.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46671 req_id = 972a60b9-39bb-48e5-bf43-116ec507ce21 response_code = 204 uri = /vpc-routes
18252024-11-07T00:06:12.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60449
18262024-11-07T00:06:12.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60449 req_id = 41480576-401c-44e8-ab37-e3f0d5ba78b1 response_code = 200 uri = /v2p
18272024-11-07T00:06:12.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52194
18282024-11-07T00:06:12.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18292024-11-07T00:06:12.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18302024-11-07T00:06:12.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52194 req_id = e731b334-c0d2-4b41-8e86-2e4ed12320ea response_code = 204 uri = /switch-ports
18312024-11-07T00:06:12.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52194 req_id = c2a2e4e2-ee9f-48b4-8075-afb747ae656c response_code = 200 uri = /network-bootstore-config
18322024-11-07T00:06:13.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53138
18332024-11-07T00:06:13.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53138 req_id = b98262a6-a85d-4f3c-a250-208f666ba433 response_code = 200 uri = /vpc-routes
18342024-11-07T00:06:13.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52280
18352024-11-07T00:06:13.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52280 req_id = 500764c2-e225-4934-85d6-ce12935d44ac response_code = 200 uri = /v2p
18362024-11-07T00:06:13.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
18372024-11-07T00:06:13.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53138 req_id = 8c6a7c37-2133-4cb8-89aa-11cc262abb5b response_code = 204 uri = /eip-gateways
18382024-11-07T00:06:13.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53138 req_id = 83dc06d0-7037-4d74-ad85-37ae70aab328 response_code = 204 uri = /vpc-routes
18392024-11-07T00:06:13.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58136
18402024-11-07T00:06:13.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18412024-11-07T00:06:13.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18422024-11-07T00:06:13.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58136 req_id = 25cb91ba-2fb4-412f-9a84-a6651d1ecd54 response_code = 204 uri = /switch-ports
18432024-11-07T00:06:13.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58136 req_id = 43e85d2c-96b1-4d2b-951f-a12b646280b7 response_code = 200 uri = /network-bootstore-config
18442024-11-07T00:06:13.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48709
18452024-11-07T00:06:13.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48709 req_id = 00502452-7954-482a-a5c8-8ca80b7deefa response_code = 200 uri = /vpc-routes
18462024-11-07T00:06:14.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
18472024-11-07T00:06:14.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48709 req_id = df32b394-e5fb-47b4-b829-7dbdaac0d750 response_code = 204 uri = /eip-gateways
18482024-11-07T00:06:14.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48709 req_id = 03439183-4a6d-4706-9891-75902769804c response_code = 204 uri = /vpc-routes
18492024-11-07T00:06:14.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46501
18502024-11-07T00:06:14.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46501 req_id = 68cf410b-fbd2-4931-8f36-ebe3abbc070d response_code = 200 uri = /v2p
18512024-11-07T00:06:14.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56735
18522024-11-07T00:06:14.095ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18532024-11-07T00:06:14.135ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18542024-11-07T00:06:14.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99029 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56735 req_id = d34f874c-2c43-4e8b-ac5e-9ca148bc8b74 response_code = 204 uri = /switch-ports
18552024-11-07T00:06:14.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56735 req_id = fbe328c0-aba0-4a5f-a1ee-287543ad497f response_code = 200 uri = /network-bootstore-config
18562024-11-07T00:06:27.939ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54202
18572024-11-07T00:06:27.940ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54202 req_id = 2d27d844-af96-487f-a6a2-38c12915e38c response_code = 200 uri = /baseboard
18582024-11-07T00:06:42.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48987
18592024-11-07T00:06:42.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48987 req_id = fc11aa49-d4cb-485a-b802-430b1c9e520f response_code = 200 uri = /vpc-routes
18602024-11-07T00:06:42.753ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
18612024-11-07T00:06:42.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48987 req_id = f200deb1-1dca-4c02-b858-a75d50e4f52a response_code = 204 uri = /eip-gateways
18622024-11-07T00:06:42.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48987 req_id = 767cb4b5-4389-4ad1-af62-2a4087acf37f response_code = 204 uri = /vpc-routes
18632024-11-07T00:06:42.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41494
18642024-11-07T00:06:42.832ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18652024-11-07T00:06:42.876ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18662024-11-07T00:06:42.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41494 req_id = 9a87a802-ac90-4775-8154-5280c62cb178 response_code = 204 uri = /switch-ports
18672024-11-07T00:06:42.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57908
18682024-11-07T00:06:42.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57908 req_id = 1d67742b-11b9-4c16-ab29-4759fd226a6e response_code = 200 uri = /v2p
18692024-11-07T00:06:42.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41494 req_id = e0bee04e-0ca8-4e64-95c2-6ed22a4fb3bd response_code = 200 uri = /network-bootstore-config
18702024-11-07T00:06:43.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52013
18712024-11-07T00:06:43.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52013 req_id = a29c5798-191c-4f4c-bc7c-6dd65e1c8b08 response_code = 200 uri = /vpc-routes
18722024-11-07T00:06:43.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
18732024-11-07T00:06:43.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52013 req_id = df0ad0fb-b8d5-4a0f-b4ad-16fc8e9a61a2 response_code = 204 uri = /eip-gateways
18742024-11-07T00:06:43.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52013 req_id = 2703937c-8140-494b-bc10-9bbb4fe5be4f response_code = 204 uri = /vpc-routes
18752024-11-07T00:06:43.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53756
18762024-11-07T00:06:43.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53756 req_id = 8841e1b4-177b-4e22-884d-904edeada96a response_code = 200 uri = /v2p
18772024-11-07T00:06:43.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45828
18782024-11-07T00:06:43.836ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18792024-11-07T00:06:43.893ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18802024-11-07T00:06:43.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45828 req_id = edc43a65-af94-4922-ae35-f7ce77505306 response_code = 204 uri = /switch-ports
18812024-11-07T00:06:43.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45828 req_id = 2a24eeba-418e-4b92-b08b-56863e69b701 response_code = 200 uri = /network-bootstore-config
18822024-11-07T00:06:44.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41823
18832024-11-07T00:06:44.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41823 req_id = 4fbb8ba8-8f68-4e63-ba72-1d9824d61be0 response_code = 200 uri = /vpc-routes
18842024-11-07T00:06:44.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
18852024-11-07T00:06:44.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41823 req_id = f9256603-697e-46e4-b677-3f27d8feb9f4 response_code = 204 uri = /eip-gateways
18862024-11-07T00:06:44.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41823 req_id = bd829633-b764-4026-a979-c77833954f32 response_code = 204 uri = /vpc-routes
18872024-11-07T00:06:44.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48346
18882024-11-07T00:06:44.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18892024-11-07T00:06:44.299ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18902024-11-07T00:06:44.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48346 req_id = d1cee906-f20d-4cef-8dc8-7d4519a10ba9 response_code = 204 uri = /switch-ports
18912024-11-07T00:06:44.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45726
18922024-11-07T00:06:44.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48346 req_id = 14bf10d9-7513-498a-8a77-19c7527d35aa response_code = 200 uri = /network-bootstore-config
18932024-11-07T00:06:44.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45726 req_id = f45c0271-85e5-48f5-ab59-0ac06e6529d7 response_code = 200 uri = /v2p
18942024-11-07T00:06:48.118ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
18952024-11-07T00:06:48.120ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
18962024-11-07T00:06:48.121ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
18972024-11-07T00:06:48.122ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
18982024-11-07T00:06:48.122ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
18992024-11-07T00:06:48.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
19002024-11-07T00:06:48.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
19012024-11-07T00:06:48.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
19022024-11-07T00:06:48.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 69a45541-8490-420b-8636-983c871692fd
19032024-11-07T00:06:57.974ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41655
19042024-11-07T00:06:57.974ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41655 req_id = adc91d8f-5199-4fbd-be28-ba7a3265f2cd response_code = 200 uri = /baseboard
19052024-11-07T00:06:58.120ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19062024-11-07T00:06:58.120ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19072024-11-07T00:06:58.121ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19082024-11-07T00:06:58.122ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19092024-11-07T00:06:58.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19102024-11-07T00:06:58.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19112024-11-07T00:06:58.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19122024-11-07T00:06:58.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19132024-11-07T00:06:58.126ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19142024-11-07T00:06:58.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19152024-11-07T00:06:58.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19162024-11-07T00:06:58.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19172024-11-07T00:06:58.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19182024-11-07T00:06:58.129ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19192024-11-07T00:06:58.129ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19202024-11-07T00:06:58.130ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19212024-11-07T00:06:58.130ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19222024-11-07T00:06:58.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19232024-11-07T00:07:08.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19242024-11-07T00:07:08.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19252024-11-07T00:07:08.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19262024-11-07T00:07:08.126ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19272024-11-07T00:07:08.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19282024-11-07T00:07:08.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19292024-11-07T00:07:08.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19302024-11-07T00:07:08.129ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19312024-11-07T00:07:08.129ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19322024-11-07T00:07:08.130ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19332024-11-07T00:07:08.131ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19342024-11-07T00:07:08.131ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19352024-11-07T00:07:08.132ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19362024-11-07T00:07:08.132ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19372024-11-07T00:07:08.133ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19382024-11-07T00:07:08.133ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19392024-11-07T00:07:08.134ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19402024-11-07T00:07:08.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19412024-11-07T00:07:12.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62093
19422024-11-07T00:07:12.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62093 req_id = 8caffce1-726f-4232-b3b6-1a3faca479bd response_code = 200 uri = /vpc-routes
19432024-11-07T00:07:12.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
19442024-11-07T00:07:12.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62093 req_id = 37a47631-d457-4498-ada5-bde68cd92277 response_code = 204 uri = /eip-gateways
19452024-11-07T00:07:12.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36349
19462024-11-07T00:07:12.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36349 req_id = 1936a00c-01c7-4d8a-94b3-326f25b5b19a response_code = 200 uri = /v2p
19472024-11-07T00:07:12.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62093 req_id = 7ee62f4f-45d4-41d7-ad7f-6ed7c605921e response_code = 204 uri = /vpc-routes
19482024-11-07T00:07:12.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52127
19492024-11-07T00:07:12.703ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19502024-11-07T00:07:12.743ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19512024-11-07T00:07:12.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98231 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52127 req_id = 635c7762-41e5-4583-b959-0ff91d7b189d response_code = 204 uri = /switch-ports
19522024-11-07T00:07:12.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52127 req_id = 9e85ef1f-45e8-4bf8-92d1-9cf01307d523 response_code = 200 uri = /network-bootstore-config
19532024-11-07T00:07:13.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45297
19542024-11-07T00:07:13.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45297 req_id = 11321842-1457-4008-9b45-b5bfce85a4f9 response_code = 200 uri = /vpc-routes
19552024-11-07T00:07:13.452ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
19562024-11-07T00:07:13.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45297 req_id = 445e4ea3-c525-4fa9-9a38-a321d01b9bc9 response_code = 204 uri = /eip-gateways
19572024-11-07T00:07:13.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45297 req_id = eac25755-3ab0-49c9-8887-295d826c5d22 response_code = 204 uri = /vpc-routes
19582024-11-07T00:07:13.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53717
19592024-11-07T00:07:13.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53717 req_id = 1cb287c1-cd3f-46fd-bfda-b55c78020e6a response_code = 200 uri = /v2p
19602024-11-07T00:07:13.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49480
19612024-11-07T00:07:13.738ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19622024-11-07T00:07:13.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19632024-11-07T00:07:13.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49480 req_id = aaa90394-44c8-436d-b312-d5b55244746e response_code = 204 uri = /switch-ports
19642024-11-07T00:07:13.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49480 req_id = da5ef953-9bd8-42a9-af2a-1cd4abcb12b0 response_code = 200 uri = /network-bootstore-config
19652024-11-07T00:07:14.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64746
19662024-11-07T00:07:14.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64746 req_id = 0814acbb-7419-4b13-87da-34dfc64e0f60 response_code = 200 uri = /v2p
19672024-11-07T00:07:14.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44758
19682024-11-07T00:07:14.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44758 req_id = f417577f-e851-4378-a6c9-67183ba476ba response_code = 200 uri = /vpc-routes
19692024-11-07T00:07:14.166ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
19702024-11-07T00:07:14.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44758 req_id = 0c3ef78b-9876-4216-ad0a-b14b04ab7982 response_code = 204 uri = /eip-gateways
19712024-11-07T00:07:14.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44758 req_id = b1a73ca6-adac-4e8a-b17d-85f9d360b2bb response_code = 204 uri = /vpc-routes
19722024-11-07T00:07:14.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59635
19732024-11-07T00:07:14.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19742024-11-07T00:07:14.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19752024-11-07T00:07:14.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59635 req_id = 11ee06de-c78a-4bd4-b541-c3a5965f1937 response_code = 204 uri = /switch-ports
19762024-11-07T00:07:14.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59635 req_id = 864f5d95-c902-4e4e-ae05-f8c7fd104936 response_code = 200 uri = /network-bootstore-config
19772024-11-07T00:07:18.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19782024-11-07T00:07:18.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19792024-11-07T00:07:18.129ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19802024-11-07T00:07:18.130ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19812024-11-07T00:07:18.130ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19822024-11-07T00:07:18.131ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19832024-11-07T00:07:18.132ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19842024-11-07T00:07:18.132ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19852024-11-07T00:07:18.133ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19862024-11-07T00:07:18.134ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19872024-11-07T00:07:18.134ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19882024-11-07T00:07:18.135ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19892024-11-07T00:07:18.135ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19902024-11-07T00:07:18.136ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19912024-11-07T00:07:18.136ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19922024-11-07T00:07:18.137ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19932024-11-07T00:07:18.137ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19942024-11-07T00:07:18.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19952024-11-07T00:07:28.007ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65100
19962024-11-07T00:07:28.007ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65100 req_id = fa0620dd-646f-42f7-838f-d3ac15a41b7d response_code = 200 uri = /baseboard
19972024-11-07T00:07:28.131ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19982024-11-07T00:07:28.131ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
19992024-11-07T00:07:28.132ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20002024-11-07T00:07:28.133ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20012024-11-07T00:07:28.134ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20022024-11-07T00:07:28.134ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20032024-11-07T00:07:28.135ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20042024-11-07T00:07:28.135ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20052024-11-07T00:07:28.136ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20062024-11-07T00:07:28.137ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20072024-11-07T00:07:28.137ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20082024-11-07T00:07:28.138ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20092024-11-07T00:07:28.138ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20102024-11-07T00:07:28.139ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20112024-11-07T00:07:28.139ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20122024-11-07T00:07:28.140ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20132024-11-07T00:07:28.140ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20142024-11-07T00:07:28.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20152024-11-07T00:07:34.835ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
20162024-11-07T00:07:34.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
20172024-11-07T00:07:34.868ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4173, tv_nsec: 305974493 } time_to_next_cleanup = 599.999996149s
20182024-11-07T00:07:38.134ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20192024-11-07T00:07:38.135ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20202024-11-07T00:07:38.136ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20212024-11-07T00:07:38.137ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20222024-11-07T00:07:38.137ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20232024-11-07T00:07:38.138ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20242024-11-07T00:07:38.139ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20252024-11-07T00:07:38.139ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20262024-11-07T00:07:38.140ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20272024-11-07T00:07:38.141ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20282024-11-07T00:07:38.141ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20292024-11-07T00:07:38.142ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20302024-11-07T00:07:38.142ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20312024-11-07T00:07:38.143ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20322024-11-07T00:07:38.143ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20332024-11-07T00:07:38.144ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20342024-11-07T00:07:38.144ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20352024-11-07T00:07:38.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20362024-11-07T00:07:42.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45333
20372024-11-07T00:07:42.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45333 req_id = dd5a56e5-ea96-473d-a815-cdbd93b4048a response_code = 200 uri = /vpc-routes
20382024-11-07T00:07:42.756ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
20392024-11-07T00:07:42.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45333 req_id = c8095655-6b7c-4d43-861a-806ad6421e83 response_code = 204 uri = /eip-gateways
20402024-11-07T00:07:42.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45333 req_id = 8273f982-f17e-4f7b-9970-b6d3fca83180 response_code = 204 uri = /vpc-routes
20412024-11-07T00:07:42.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52285
20422024-11-07T00:07:42.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52285 req_id = 20e66a44-40c5-4ce3-b16b-90102220434a response_code = 200 uri = /v2p
20432024-11-07T00:07:42.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55549
20442024-11-07T00:07:42.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20452024-11-07T00:07:42.900ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20462024-11-07T00:07:42.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55549 req_id = 69781feb-a933-45b0-97af-e4f2bea1276a response_code = 204 uri = /switch-ports
20472024-11-07T00:07:42.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55549 req_id = 365b4eef-e266-4826-a69e-86340aa95b12 response_code = 200 uri = /network-bootstore-config
20482024-11-07T00:07:43.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34261
20492024-11-07T00:07:43.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34261 req_id = 38ddca54-a3ca-4a15-b010-e6cbd1e82433 response_code = 200 uri = /vpc-routes
20502024-11-07T00:07:43.643ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
20512024-11-07T00:07:43.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34261 req_id = 6c9e6300-ae92-4a01-8f6f-e2062c06b654 response_code = 204 uri = /eip-gateways
20522024-11-07T00:07:43.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34261 req_id = 3a2ade7d-e52b-42a0-a3b3-b9ff9b335a99 response_code = 204 uri = /vpc-routes
20532024-11-07T00:07:43.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63997
20542024-11-07T00:07:43.753ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20552024-11-07T00:07:43.795ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20562024-11-07T00:07:43.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63997 req_id = d2749fef-c5c7-4c8e-b4bb-b1c2415151b2 response_code = 204 uri = /switch-ports
20572024-11-07T00:07:43.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34412
20582024-11-07T00:07:43.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63997 req_id = d06230a5-f255-4922-b7ab-a0e30f7b3112 response_code = 200 uri = /network-bootstore-config
20592024-11-07T00:07:43.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34412 req_id = 33671e81-f2f5-4c81-b717-399e3fddbedd response_code = 200 uri = /v2p
20602024-11-07T00:07:44.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52676
20612024-11-07T00:07:44.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52676 req_id = 84a55ad8-98a1-44f3-8f23-594cc184de7f response_code = 200 uri = /vpc-routes
20622024-11-07T00:07:44.300ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
20632024-11-07T00:07:44.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52676 req_id = bdcedd98-abf6-46e6-ae94-188b2b300036 response_code = 204 uri = /eip-gateways
20642024-11-07T00:07:44.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62325
20652024-11-07T00:07:44.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62325 req_id = 3374b3f2-3495-4001-a80e-c1e0a45548a2 response_code = 200 uri = /v2p
20662024-11-07T00:07:44.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52676 req_id = 50258a78-511f-42af-91e8-97c46f264226 response_code = 204 uri = /vpc-routes
20672024-11-07T00:07:44.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60987
20682024-11-07T00:07:44.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20692024-11-07T00:07:44.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20702024-11-07T00:07:44.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60987 req_id = c44536d5-3006-4858-8de3-0449a13ed93c response_code = 204 uri = /switch-ports
20712024-11-07T00:07:44.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60987 req_id = 899439f4-0382-418a-9888-61d24566569f response_code = 200 uri = /network-bootstore-config
20722024-11-07T00:07:48.138ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20732024-11-07T00:07:48.139ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20742024-11-07T00:07:48.139ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20752024-11-07T00:07:48.140ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20762024-11-07T00:07:48.141ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20772024-11-07T00:07:48.141ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20782024-11-07T00:07:48.142ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20792024-11-07T00:07:48.143ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20802024-11-07T00:07:48.143ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20812024-11-07T00:07:48.144ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20822024-11-07T00:07:48.144ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20832024-11-07T00:07:48.145ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20842024-11-07T00:07:48.145ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20852024-11-07T00:07:48.146ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20862024-11-07T00:07:48.146ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20872024-11-07T00:07:48.147ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20882024-11-07T00:07:48.147ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20892024-11-07T00:07:48.296ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20902024-11-07T00:07:49.006ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20912024-11-07T00:07:58.042ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57134
20922024-11-07T00:07:58.042ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57134 req_id = 5656cb63-d20e-43c3-bd06-67c8e8c779e2 response_code = 200 uri = /baseboard
20932024-11-07T00:07:58.141ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20942024-11-07T00:07:58.142ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20952024-11-07T00:07:58.142ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20962024-11-07T00:07:58.143ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20972024-11-07T00:07:58.144ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20982024-11-07T00:07:58.144ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
20992024-11-07T00:07:58.145ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21002024-11-07T00:07:58.145ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21012024-11-07T00:07:58.146ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21022024-11-07T00:07:58.147ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21032024-11-07T00:07:58.147ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21042024-11-07T00:07:58.148ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21052024-11-07T00:07:58.148ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21062024-11-07T00:07:58.149ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21072024-11-07T00:07:58.149ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21082024-11-07T00:07:58.150ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21092024-11-07T00:07:58.150ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21102024-11-07T00:07:58.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21112024-11-07T00:08:08.145ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21122024-11-07T00:08:08.146ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21132024-11-07T00:08:08.147ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21142024-11-07T00:08:08.147ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21152024-11-07T00:08:08.148ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21162024-11-07T00:08:08.149ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21172024-11-07T00:08:08.149ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21182024-11-07T00:08:08.150ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21192024-11-07T00:08:08.151ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21202024-11-07T00:08:08.151ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21212024-11-07T00:08:08.152ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21222024-11-07T00:08:08.152ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21232024-11-07T00:08:08.153ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21242024-11-07T00:08:08.153ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21252024-11-07T00:08:08.154ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21262024-11-07T00:08:08.154ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21272024-11-07T00:08:08.155ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21282024-11-07T00:08:08.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21292024-11-07T00:08:12.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55191
21302024-11-07T00:08:12.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55191 req_id = aceba177-cd48-445d-a47d-8bd7f56b5066 response_code = 200 uri = /vpc-routes
21312024-11-07T00:08:12.598ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
21322024-11-07T00:08:12.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55191 req_id = 743df518-3550-41cf-a50a-76cd383550fa response_code = 204 uri = /eip-gateways
21332024-11-07T00:08:12.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55191 req_id = c5bb3a87-0755-406b-a918-d7fd1e10ac77 response_code = 204 uri = /vpc-routes
21342024-11-07T00:08:12.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41441
21352024-11-07T00:08:12.652ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21362024-11-07T00:08:12.693ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21372024-11-07T00:08:12.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41441 req_id = 1a0942fc-b1b1-4523-b0c7-11c187980495 response_code = 204 uri = /switch-ports
21382024-11-07T00:08:12.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53492
21392024-11-07T00:08:12.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53492 req_id = 22ba128a-7fd2-402b-a142-7f0139490b7f response_code = 200 uri = /v2p
21402024-11-07T00:08:12.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41441 req_id = 7f935ef3-bd1f-49b7-95ac-fa9d5d97e9f1 response_code = 200 uri = /network-bootstore-config
21412024-11-07T00:08:13.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63905
21422024-11-07T00:08:13.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63905 req_id = 8e046272-4b0f-4c50-b951-2e3b178b9cc0 response_code = 200 uri = /vpc-routes
21432024-11-07T00:08:13.501ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
21442024-11-07T00:08:13.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63905 req_id = a8676b22-d487-46cd-832e-6f25d86dddf9 response_code = 204 uri = /eip-gateways
21452024-11-07T00:08:13.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63905 req_id = 3383a935-286a-422b-855e-1e9383ed0525 response_code = 204 uri = /vpc-routes
21462024-11-07T00:08:13.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63195
21472024-11-07T00:08:13.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63195 req_id = 300608e3-281b-4532-acf9-c5aa33534784 response_code = 200 uri = /v2p
21482024-11-07T00:08:13.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65517
21492024-11-07T00:08:13.625ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21502024-11-07T00:08:13.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21512024-11-07T00:08:13.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102776 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65517 req_id = 83616b8a-8471-4667-89ae-4c03ef3f4846 response_code = 204 uri = /switch-ports
21522024-11-07T00:08:13.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65517 req_id = 3f970024-80ce-4046-a852-78a0f822d87f response_code = 200 uri = /network-bootstore-config
21532024-11-07T00:08:13.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59459
21542024-11-07T00:08:13.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59459 req_id = d2b1e8e9-5445-42f9-893e-65680ed627cb response_code = 200 uri = /vpc-routes
21552024-11-07T00:08:14.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
21562024-11-07T00:08:14.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59459 req_id = c71c0296-a3ea-4472-9ab5-63faa805f6a3 response_code = 204 uri = /eip-gateways
21572024-11-07T00:08:14.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59459 req_id = a7698a8e-7ff5-418e-8047-e779818540d1 response_code = 204 uri = /vpc-routes
21582024-11-07T00:08:14.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44723
21592024-11-07T00:08:14.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44723 req_id = 64c0ac96-75c3-473d-ab65-fc42238eb542 response_code = 200 uri = /v2p
21602024-11-07T00:08:14.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40266
21612024-11-07T00:08:14.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21622024-11-07T00:08:14.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21632024-11-07T00:08:14.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102843 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40266 req_id = 14d999f1-7181-48d6-a9a4-43b154560fcb response_code = 204 uri = /switch-ports
21642024-11-07T00:08:14.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40266 req_id = bfef252b-f287-4ee1-a272-2b7979d7423a response_code = 200 uri = /network-bootstore-config
21652024-11-07T00:08:18.149ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21662024-11-07T00:08:18.150ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21672024-11-07T00:08:18.151ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21682024-11-07T00:08:18.151ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21692024-11-07T00:08:18.152ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21702024-11-07T00:08:18.153ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21712024-11-07T00:08:18.153ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21722024-11-07T00:08:18.154ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21732024-11-07T00:08:18.154ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21742024-11-07T00:08:18.155ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21752024-11-07T00:08:18.156ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21762024-11-07T00:08:18.156ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21772024-11-07T00:08:18.157ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21782024-11-07T00:08:18.157ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21792024-11-07T00:08:18.158ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21802024-11-07T00:08:18.158ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21812024-11-07T00:08:18.158ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21822024-11-07T00:08:18.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21832024-11-07T00:08:28.075ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36564
21842024-11-07T00:08:28.075ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36564 req_id = 51c4289d-a49d-4e3a-9e26-25277cab6545 response_code = 200 uri = /baseboard
21852024-11-07T00:08:28.153ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21862024-11-07T00:08:28.154ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21872024-11-07T00:08:28.155ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21882024-11-07T00:08:28.155ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21892024-11-07T00:08:28.156ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21902024-11-07T00:08:28.157ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21912024-11-07T00:08:28.157ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21922024-11-07T00:08:28.158ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21932024-11-07T00:08:28.158ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21942024-11-07T00:08:28.159ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21952024-11-07T00:08:28.160ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21962024-11-07T00:08:28.160ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21972024-11-07T00:08:28.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21982024-11-07T00:08:28.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
21992024-11-07T00:08:28.162ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22002024-11-07T00:08:28.162ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22012024-11-07T00:08:28.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22022024-11-07T00:08:28.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22032024-11-07T00:08:38.157ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22042024-11-07T00:08:38.158ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22052024-11-07T00:08:38.158ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22062024-11-07T00:08:38.159ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22072024-11-07T00:08:38.160ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22082024-11-07T00:08:38.160ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22092024-11-07T00:08:38.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22102024-11-07T00:08:38.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22112024-11-07T00:08:38.162ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22122024-11-07T00:08:38.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22132024-11-07T00:08:38.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22142024-11-07T00:08:38.164ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22152024-11-07T00:08:38.164ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22162024-11-07T00:08:38.165ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22172024-11-07T00:08:38.165ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22182024-11-07T00:08:38.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22192024-11-07T00:08:38.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22202024-11-07T00:08:38.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22212024-11-07T00:08:42.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36037
22222024-11-07T00:08:42.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36037 req_id = 36675f7d-51bf-4527-9dbb-33ac54b7cf30 response_code = 200 uri = /vpc-routes
22232024-11-07T00:08:42.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
22242024-11-07T00:08:42.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36037 req_id = 59c85315-b05f-46ce-9469-74ee52631dd2 response_code = 204 uri = /eip-gateways
22252024-11-07T00:08:42.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36037 req_id = e28e8742-7af3-49e0-b60b-2025b28c13d2 response_code = 204 uri = /vpc-routes
22262024-11-07T00:08:42.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56931
22272024-11-07T00:08:42.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56931 req_id = dcf1331e-2bd9-4765-b22e-b31d4af5772d response_code = 200 uri = /v2p
22282024-11-07T00:08:42.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33564
22292024-11-07T00:08:42.869ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22302024-11-07T00:08:42.916ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22312024-11-07T00:08:42.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128275 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33564 req_id = 0002aa80-3027-409b-87b2-4c3ff35fd6a6 response_code = 204 uri = /switch-ports
22322024-11-07T00:08:42.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33564 req_id = 8b23538d-0511-4a33-b6d2-178e8ec18eb8 response_code = 200 uri = /network-bootstore-config
22332024-11-07T00:08:43.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55235
22342024-11-07T00:08:43.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55235 req_id = 92288a71-803a-43d8-894b-1eb44a7b8470 response_code = 200 uri = /vpc-routes
22352024-11-07T00:08:43.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
22362024-11-07T00:08:43.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55235 req_id = c1344c1d-409c-4a95-9939-b4b91b0a5439 response_code = 204 uri = /eip-gateways
22372024-11-07T00:08:43.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55235 req_id = 8cac7578-9665-4124-8ecb-767483e28ad1 response_code = 204 uri = /vpc-routes
22382024-11-07T00:08:43.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45907
22392024-11-07T00:08:43.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45907 req_id = 38130002-8bf5-4b3e-b533-5fe29652c76f response_code = 200 uri = /v2p
22402024-11-07T00:08:43.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42851
22412024-11-07T00:08:43.879ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22422024-11-07T00:08:43.937ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22432024-11-07T00:08:44.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42851 req_id = 19333a86-466d-4f8a-8ded-dd6c2cb0aaf1 response_code = 204 uri = /switch-ports
22442024-11-07T00:08:44.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42851 req_id = 40114d98-b668-4e27-823e-b770e9b39307 response_code = 200 uri = /network-bootstore-config
22452024-11-07T00:08:44.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62692
22462024-11-07T00:08:44.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62692 req_id = 7cfc5869-36e9-4fa0-97f1-4d03e943e7cd response_code = 200 uri = /vpc-routes
22472024-11-07T00:08:44.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
22482024-11-07T00:08:44.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62692 req_id = f1c768af-bdb0-4bb9-93d1-27b2d56a2adf response_code = 204 uri = /eip-gateways
22492024-11-07T00:08:44.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62692 req_id = 55fa4cf8-d6ed-49a8-a595-7862dfd5c60f response_code = 204 uri = /vpc-routes
22502024-11-07T00:08:44.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46798
22512024-11-07T00:08:44.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46798 req_id = 72710d61-1640-4f7c-838f-4656c7ae3177 response_code = 200 uri = /v2p
22522024-11-07T00:08:44.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33271
22532024-11-07T00:08:44.295ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22542024-11-07T00:08:44.331ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22552024-11-07T00:08:44.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33271 req_id = a26446d5-c23e-42fa-8307-02148ab5b7d5 response_code = 204 uri = /switch-ports
22562024-11-07T00:08:44.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33271 req_id = 695a7f5c-6779-4df9-a7f4-3a41ccd7b05c response_code = 200 uri = /network-bootstore-config
22572024-11-07T00:08:48.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22582024-11-07T00:08:48.161ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22592024-11-07T00:08:48.162ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22602024-11-07T00:08:48.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22612024-11-07T00:08:48.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22622024-11-07T00:08:48.164ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22632024-11-07T00:08:48.165ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22642024-11-07T00:08:48.165ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22652024-11-07T00:08:48.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22662024-11-07T00:08:48.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22672024-11-07T00:08:48.167ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22682024-11-07T00:08:48.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22692024-11-07T00:08:48.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22702024-11-07T00:08:48.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22712024-11-07T00:08:48.169ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22722024-11-07T00:08:48.169ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22732024-11-07T00:08:48.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22742024-11-07T00:08:48.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22752024-11-07T00:08:58.108ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38662
22762024-11-07T00:08:58.108ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38662 req_id = dbf3be42-d583-4e00-99f1-eeff98c32b47 response_code = 200 uri = /baseboard
22772024-11-07T00:08:58.163ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22782024-11-07T00:08:58.164ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22792024-11-07T00:08:58.164ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22802024-11-07T00:08:58.165ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22812024-11-07T00:08:58.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22822024-11-07T00:08:58.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22832024-11-07T00:08:58.167ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22842024-11-07T00:08:58.167ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22852024-11-07T00:08:58.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22862024-11-07T00:08:58.169ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22872024-11-07T00:08:58.169ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22882024-11-07T00:08:58.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22892024-11-07T00:08:58.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22902024-11-07T00:08:58.171ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22912024-11-07T00:08:58.171ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22922024-11-07T00:08:58.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22932024-11-07T00:08:58.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22942024-11-07T00:08:58.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22952024-11-07T00:09:08.166ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22962024-11-07T00:09:08.167ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22972024-11-07T00:09:08.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22982024-11-07T00:09:08.168ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
22992024-11-07T00:09:08.169ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23002024-11-07T00:09:08.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23012024-11-07T00:09:08.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23022024-11-07T00:09:08.171ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23032024-11-07T00:09:08.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23042024-11-07T00:09:08.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23052024-11-07T00:09:08.173ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23062024-11-07T00:09:08.173ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23072024-11-07T00:09:08.174ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23082024-11-07T00:09:08.174ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23092024-11-07T00:09:08.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23102024-11-07T00:09:08.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23112024-11-07T00:09:08.176ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23122024-11-07T00:09:08.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23132024-11-07T00:09:12.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33616
23142024-11-07T00:09:12.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33616 req_id = 4b0421ca-47af-4a0e-9e1f-53938fefc4e1 response_code = 200 uri = /vpc-routes
23152024-11-07T00:09:12.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
23162024-11-07T00:09:12.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33616 req_id = d69823bf-6c9a-4b86-92ab-94308d44b845 response_code = 204 uri = /eip-gateways
23172024-11-07T00:09:12.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33616 req_id = 5a7d694a-b98d-4239-a7d0-72c02e96e6ac response_code = 204 uri = /vpc-routes
23182024-11-07T00:09:12.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50404
23192024-11-07T00:09:12.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23202024-11-07T00:09:12.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23212024-11-07T00:09:12.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50404 req_id = d7a75bb8-35c6-4a32-b85d-d5549f7cdd7a response_code = 204 uri = /switch-ports
23222024-11-07T00:09:12.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51895
23232024-11-07T00:09:12.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51895 req_id = ae97d8f9-20e0-4a36-a6d3-336275460078 response_code = 200 uri = /v2p
23242024-11-07T00:09:12.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50404 req_id = ea24ab29-dd81-4a5e-a98e-dcdc9743d218 response_code = 200 uri = /network-bootstore-config
23252024-11-07T00:09:13.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35225
23262024-11-07T00:09:13.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35225 req_id = 97c0df18-6bda-4a3a-aaff-8b7a32849588 response_code = 200 uri = /vpc-routes
23272024-11-07T00:09:13.497ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
23282024-11-07T00:09:13.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35225 req_id = d3a39152-5815-4b8f-adaf-b3fa1e261dc1 response_code = 204 uri = /eip-gateways
23292024-11-07T00:09:13.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51255
23302024-11-07T00:09:13.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51255 req_id = c859532e-0518-473b-8ddd-63fc082001e0 response_code = 200 uri = /v2p
23312024-11-07T00:09:13.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35225 req_id = dc1ebedb-69b4-4eb9-9e61-87493b5c3c71 response_code = 204 uri = /vpc-routes
23322024-11-07T00:09:13.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62629
23332024-11-07T00:09:13.564ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23342024-11-07T00:09:13.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23352024-11-07T00:09:13.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62629 req_id = 8c6f7ae0-9df6-4b54-b423-79642b86a40c response_code = 204 uri = /switch-ports
23362024-11-07T00:09:13.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62629 req_id = 4cf4aee8-53a4-4b9b-9c04-f7deed071d07 response_code = 200 uri = /network-bootstore-config
23372024-11-07T00:09:14.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64614
23382024-11-07T00:09:14.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64614 req_id = 876d08e4-c922-47c0-9cd4-305702715cec response_code = 200 uri = /vpc-routes
23392024-11-07T00:09:14.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
23402024-11-07T00:09:14.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64614 req_id = 487d3257-36fd-44e6-810a-ce52ed325e0d response_code = 204 uri = /eip-gateways
23412024-11-07T00:09:14.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34207
23422024-11-07T00:09:14.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34207 req_id = b71e2269-758a-424e-b163-f13d3daa4af8 response_code = 200 uri = /v2p
23432024-11-07T00:09:14.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64614 req_id = cc723b78-d5d0-4042-9b33-2c757b5c8f08 response_code = 204 uri = /vpc-routes
23442024-11-07T00:09:14.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59397
23452024-11-07T00:09:14.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23462024-11-07T00:09:14.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23472024-11-07T00:09:14.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59397 req_id = 6c956102-5882-41f4-b3a4-6d2a7cc1cf9c response_code = 204 uri = /switch-ports
23482024-11-07T00:09:14.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59397 req_id = f4fb711b-0d23-4987-ae2e-538ac5b13fe7 response_code = 200 uri = /network-bootstore-config
23492024-11-07T00:09:18.169ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23502024-11-07T00:09:18.170ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23512024-11-07T00:09:18.171ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23522024-11-07T00:09:18.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23532024-11-07T00:09:18.172ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23542024-11-07T00:09:18.173ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23552024-11-07T00:09:18.174ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23562024-11-07T00:09:18.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23572024-11-07T00:09:18.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23582024-11-07T00:09:18.176ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23592024-11-07T00:09:18.177ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23602024-11-07T00:09:18.177ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23612024-11-07T00:09:18.178ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23622024-11-07T00:09:18.178ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23632024-11-07T00:09:18.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23642024-11-07T00:09:18.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23652024-11-07T00:09:18.180ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23662024-11-07T00:09:18.311ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23672024-11-07T00:09:28.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57907
23682024-11-07T00:09:28.145ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57907 req_id = 6b1a3d62-3dc9-42ff-bb95-ed019bd90cff response_code = 200 uri = /baseboard
23692024-11-07T00:09:28.173ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23702024-11-07T00:09:28.174ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23712024-11-07T00:09:28.175ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23722024-11-07T00:09:28.176ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23732024-11-07T00:09:28.176ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23742024-11-07T00:09:28.177ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23752024-11-07T00:09:28.178ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23762024-11-07T00:09:28.178ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23772024-11-07T00:09:28.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23782024-11-07T00:09:28.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23792024-11-07T00:09:28.180ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23802024-11-07T00:09:28.181ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23812024-11-07T00:09:28.181ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23822024-11-07T00:09:28.182ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23832024-11-07T00:09:28.182ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23842024-11-07T00:09:28.183ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23852024-11-07T00:09:28.183ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23862024-11-07T00:09:28.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23872024-11-07T00:09:38.177ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23882024-11-07T00:09:38.178ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23892024-11-07T00:09:38.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23902024-11-07T00:09:38.179ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23912024-11-07T00:09:38.180ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23922024-11-07T00:09:38.181ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23932024-11-07T00:09:38.181ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23942024-11-07T00:09:38.182ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23952024-11-07T00:09:38.183ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23962024-11-07T00:09:38.183ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23972024-11-07T00:09:38.184ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23982024-11-07T00:09:38.184ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
23992024-11-07T00:09:38.185ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24002024-11-07T00:09:38.185ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24012024-11-07T00:09:38.186ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24022024-11-07T00:09:38.186ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24032024-11-07T00:09:38.187ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24042024-11-07T00:09:38.314ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24052024-11-07T00:09:42.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33510
24062024-11-07T00:09:42.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33510 req_id = 14f463ac-9be7-4f9e-bd5f-5609fe381625 response_code = 200 uri = /vpc-routes
24072024-11-07T00:09:42.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
24082024-11-07T00:09:42.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33510 req_id = 90c31c68-a2a5-4b56-85a8-d777649dad19 response_code = 204 uri = /eip-gateways
24092024-11-07T00:09:42.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53418
24102024-11-07T00:09:42.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53418 req_id = 6fbcc8f2-27a2-49e0-a57f-a4f541f7d149 response_code = 200 uri = /v2p
24112024-11-07T00:09:42.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65327
24122024-11-07T00:09:42.966ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24132024-11-07T00:09:42.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24142024-11-07T00:09:42.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24152024-11-07T00:09:42.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24162024-11-07T00:09:42.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24172024-11-07T00:09:42.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24182024-11-07T00:09:42.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24192024-11-07T00:09:42.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65327 req_id = ab22d435-5ccf-4e7a-b90a-3f75907e1c1d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24202024-11-07T00:09:42.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33510 req_id = 819e4616-a8fd-4f78-9ecd-b1e21c916929 response_code = 204 uri = /vpc-routes
24212024-11-07T00:09:43.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47334
24222024-11-07T00:09:43.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
24232024-11-07T00:09:43.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
24242024-11-07T00:09:43.022ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
24252024-11-07T00:09:43.022ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
24262024-11-07T00:09:43.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59564
24272024-11-07T00:09:43.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24282024-11-07T00:09:43.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24292024-11-07T00:09:43.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59564 req_id = 14da648f-037e-4689-8a49-bbd6bb809ef0 response_code = 204 uri = /switch-ports
24302024-11-07T00:09:43.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59564 req_id = fcbda2c0-f666-4119-8a12-b6dff13705f1 response_code = 200 uri = /network-bootstore-config
24312024-11-07T00:09:43.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225926 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47334 req_id = 190d9b4f-2b39-4c28-8314-44215d4d26b0 response_code = 200 uri = /inventory
24322024-11-07T00:09:43.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63380
24332024-11-07T00:09:43.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63380 req_id = 34b7060f-1b48-42cd-826e-00b4d6cbaa22 response_code = 200 uri = /vpc-routes
24342024-11-07T00:09:43.869ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
24352024-11-07T00:09:43.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63380 req_id = 264aaf17-75a9-408f-a0ef-b663d742ba86 response_code = 204 uri = /eip-gateways
24362024-11-07T00:09:43.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63380 req_id = cc71199f-6e29-4607-8483-b44fec2d9836 response_code = 204 uri = /vpc-routes
24372024-11-07T00:09:44.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34314
24382024-11-07T00:09:44.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34314 req_id = 8a8dd4d8-d6b8-4fba-b7d3-d6136ff98efa response_code = 200 uri = /v2p
24392024-11-07T00:09:44.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45468
24402024-11-07T00:09:44.095ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24412024-11-07T00:09:44.143ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24422024-11-07T00:09:44.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45468 req_id = f77e2add-cc00-4ef1-8da0-78d62ece1675 response_code = 204 uri = /switch-ports
24432024-11-07T00:09:44.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54551
24442024-11-07T00:09:44.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62046
24452024-11-07T00:09:44.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54551 req_id = 91e8d3dd-9919-4acd-bdbe-4c7f326f12bd response_code = 200 uri = /vpc-routes
24462024-11-07T00:09:44.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45468 req_id = 915f6edb-2266-4d86-a443-e248f9d56319 response_code = 200 uri = /network-bootstore-config
24472024-11-07T00:09:44.233ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24482024-11-07T00:09:44.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24492024-11-07T00:09:44.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24502024-11-07T00:09:44.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24512024-11-07T00:09:44.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24522024-11-07T00:09:44.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24532024-11-07T00:09:44.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24542024-11-07T00:09:44.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 426 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62046 req_id = acfb8aa6-b422-43ab-a584-18141f5e8c26 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24552024-11-07T00:09:44.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61044
24562024-11-07T00:09:44.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
24572024-11-07T00:09:44.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
24582024-11-07T00:09:44.245ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
24592024-11-07T00:09:44.245ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
24602024-11-07T00:09:44.283ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
24612024-11-07T00:09:44.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54551 req_id = a5838922-aa76-4317-aead-b8e3c368db9a response_code = 204 uri = /eip-gateways
24622024-11-07T00:09:44.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47163
24632024-11-07T00:09:44.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47163 req_id = 3beba62a-4fc5-4c26-bb15-be9788b0d875 response_code = 200 uri = /v2p
24642024-11-07T00:09:44.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43440
24652024-11-07T00:09:44.454ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
24662024-11-07T00:09:44.454ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
24672024-11-07T00:09:44.454ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4570c3a5-1712-4889-a368-30df2852f980/config/omicron-zones.json file = common/src/ledger.rs:177
24682024-11-07T00:09:44.455ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/config/omicron-zones.json file = common/src/ledger.rs:177
24692024-11-07T00:09:44.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 903 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54551 req_id = 1c9ff4de-f4d8-4707-88bb-39db7376b6c5 response_code = 204 uri = /vpc-routes
24702024-11-07T00:09:44.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245535 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61044 req_id = 7193b9d3-ef2d-4148-b312-15b28b95332b response_code = 200 uri = /inventory
24712024-11-07T00:09:44.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35433
24722024-11-07T00:09:44.534ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24732024-11-07T00:09:44.579ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24742024-11-07T00:09:44.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113074 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35433 req_id = 265938ca-af0b-40af-a275-ebb73c5c8153 response_code = 204 uri = /switch-ports
24752024-11-07T00:09:44.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53347
24762024-11-07T00:09:44.647ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 315534e6-d9a7-4ca5-878f-5dbca170ef65, kind: Service { id: a7af845e-5f6a-4084-832d-89ca63641910 }, name: Name("external-dns-a7af845e-5f6a-4084-832d-89ca63641910"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34d8c323-e2b6-45d4-83dc-c2e08aeb5ddc, kind: Service { id: 34125c18-f6d2-4048-b0f8-8f7f8bc77406 }, name: Name("external-dns-34125c18-f6d2-4048-b0f8-8f7f8bc77406"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 65b2b8d9-dbac-43d8-a269-04e996f0f20b, kind: Service { id: a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e }, name: Name("nexus-a3c8e18d-bd0a-4f96-81a7-7e5a8ead5a4e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 48])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9633277c-a105-44b6-b918-76ab74570739, kind: Service { id: 55932d39-c4ea-4c43-8a53-3921686b4728 }, name: Name("nexus-55932d39-c4ea-4c43-8a53-3921686b4728"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6368bfa-4f1a-4ce4-bbcd-d41cae1bc0dc, kind: Service { id: 9892fd59-6e52-4f0e-9815-37a2f047ca6f }, name: Name("nexus-9892fd59-6e52-4f0e-9815-37a2f047ca6f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 56])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24772024-11-07T00:09:44.648ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24782024-11-07T00:09:44.648ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24792024-11-07T00:09:44.648ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24802024-11-07T00:09:44.648ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24812024-11-07T00:09:44.648ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24822024-11-07T00:09:44.648ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24832024-11-07T00:09:44.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53347 req_id = 84a291df-fd85-46bd-ad5f-ccfa45bdfc8c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24842024-11-07T00:09:44.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35433 req_id = 9cfbe67d-6234-4868-8578-954acbeb3e0b response_code = 200 uri = /network-bootstore-config
24852024-11-07T00:09:44.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234415 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43440 req_id = 454a7ba5-263b-4cd3-807f-db3a04b2a15d response_code = 200 uri = /inventory
24862024-11-07T00:09:48.181ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24872024-11-07T00:09:48.182ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24882024-11-07T00:09:48.183ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24892024-11-07T00:09:48.183ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24902024-11-07T00:09:48.184ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24912024-11-07T00:09:48.185ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24922024-11-07T00:09:48.185ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24932024-11-07T00:09:48.186ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24942024-11-07T00:09:48.186ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24952024-11-07T00:09:48.187ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24962024-11-07T00:09:48.187ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24972024-11-07T00:09:48.188ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24982024-11-07T00:09:48.189ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
24992024-11-07T00:09:48.189ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25002024-11-07T00:09:48.189ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25012024-11-07T00:09:48.190ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25022024-11-07T00:09:48.190ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25032024-11-07T00:09:48.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25042024-11-07T00:09:58.178ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59769
25052024-11-07T00:09:58.178ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59769 req_id = baf829fb-2d2a-4df8-ac5e-222fa1a4edd8 response_code = 200 uri = /baseboard
25062024-11-07T00:09:58.185ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25072024-11-07T00:09:58.186ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25082024-11-07T00:09:58.186ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25092024-11-07T00:09:58.187ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25102024-11-07T00:09:58.188ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25112024-11-07T00:09:58.188ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25122024-11-07T00:09:58.189ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25132024-11-07T00:09:58.190ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25142024-11-07T00:09:58.190ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25152024-11-07T00:09:58.191ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25162024-11-07T00:09:58.191ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25172024-11-07T00:09:58.192ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25182024-11-07T00:09:58.193ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25192024-11-07T00:09:58.193ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25202024-11-07T00:09:58.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25212024-11-07T00:09:58.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25222024-11-07T00:09:58.195ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25232024-11-07T00:09:58.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25242024-11-07T00:10:08.188ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25252024-11-07T00:10:08.189ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25262024-11-07T00:10:08.190ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25272024-11-07T00:10:08.190ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25282024-11-07T00:10:08.191ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25292024-11-07T00:10:08.192ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25302024-11-07T00:10:08.192ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25312024-11-07T00:10:08.193ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25322024-11-07T00:10:08.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25332024-11-07T00:10:08.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25342024-11-07T00:10:08.195ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25352024-11-07T00:10:08.195ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25362024-11-07T00:10:08.196ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25372024-11-07T00:10:08.196ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25382024-11-07T00:10:08.197ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25392024-11-07T00:10:08.197ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25402024-11-07T00:10:08.198ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25412024-11-07T00:10:08.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25422024-11-07T00:10:12.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59802
25432024-11-07T00:10:12.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59802 req_id = d86eb79f-f03f-49dc-b567-7f3d9133ac89 response_code = 200 uri = /vpc-routes
25442024-11-07T00:10:12.593ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
25452024-11-07T00:10:12.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59802 req_id = 7e108fce-036d-446b-9c53-0601690cc94a response_code = 204 uri = /eip-gateways
25462024-11-07T00:10:12.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59802 req_id = dd1212da-60a7-49f5-b0c2-4f3062b77289 response_code = 204 uri = /vpc-routes
25472024-11-07T00:10:12.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33556
25482024-11-07T00:10:12.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33556 req_id = 54c455a2-c52b-4e55-8e3a-15a815e179e6 response_code = 200 uri = /v2p
25492024-11-07T00:10:12.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45022
25502024-11-07T00:10:12.752ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25512024-11-07T00:10:12.794ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25522024-11-07T00:10:12.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102348 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45022 req_id = 6b4fbdb0-7679-4f7c-9fc7-3f5d2fe196b3 response_code = 204 uri = /switch-ports
25532024-11-07T00:10:12.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45022 req_id = 7aa1e58b-b6bd-4988-80a3-1c90112077de response_code = 200 uri = /network-bootstore-config
25542024-11-07T00:10:13.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63160
25552024-11-07T00:10:13.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63160 req_id = 08bcd044-2984-4f30-a8aa-1abd0328de1e response_code = 200 uri = /vpc-routes
25562024-11-07T00:10:13.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
25572024-11-07T00:10:13.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63160 req_id = d8847c11-99f9-46c0-985f-33872272a44f response_code = 204 uri = /eip-gateways
25582024-11-07T00:10:13.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43172
25592024-11-07T00:10:13.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43172 req_id = 5ad41031-ae57-4183-ba6f-fea4f4457bf7 response_code = 200 uri = /v2p
25602024-11-07T00:10:13.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63160 req_id = a62b0628-947a-4475-a21f-d19406301020 response_code = 204 uri = /vpc-routes
25612024-11-07T00:10:13.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38264
25622024-11-07T00:10:13.654ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25632024-11-07T00:10:13.697ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25642024-11-07T00:10:13.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38264 req_id = 531f39c2-bd13-44b6-a7a6-07d2cad63a86 response_code = 204 uri = /switch-ports
25652024-11-07T00:10:13.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38264 req_id = 3c334cee-1b99-456c-ac5b-9e537ed05b37 response_code = 200 uri = /network-bootstore-config
25662024-11-07T00:10:14.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50701
25672024-11-07T00:10:14.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50701 req_id = b832b226-1ac6-4aa7-81bc-9a765628d1d0 response_code = 200 uri = /vpc-routes
25682024-11-07T00:10:14.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
25692024-11-07T00:10:14.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50701 req_id = b6a08176-9ea1-46d3-9afb-589eb1ca7402 response_code = 204 uri = /eip-gateways
25702024-11-07T00:10:14.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50701 req_id = 2b7faa54-0aee-4fde-a093-08172f22578d response_code = 204 uri = /vpc-routes
25712024-11-07T00:10:14.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47988
25722024-11-07T00:10:14.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47988 req_id = 2392c395-d693-4ac7-a4d7-e08f3bd592de response_code = 200 uri = /v2p
25732024-11-07T00:10:14.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36723
25742024-11-07T00:10:14.200ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25752024-11-07T00:10:14.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25762024-11-07T00:10:14.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36723 req_id = 78bab413-bef5-40fd-b9da-e179438c6b10 response_code = 204 uri = /switch-ports
25772024-11-07T00:10:14.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36723 req_id = fbd6be78-03c0-4dee-ab5c-9997ede9218e response_code = 200 uri = /network-bootstore-config
25782024-11-07T00:10:18.191ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25792024-11-07T00:10:18.192ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25802024-11-07T00:10:18.193ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25812024-11-07T00:10:18.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25822024-11-07T00:10:18.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25832024-11-07T00:10:18.195ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25842024-11-07T00:10:18.196ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25852024-11-07T00:10:18.196ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25862024-11-07T00:10:18.197ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25872024-11-07T00:10:18.197ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25882024-11-07T00:10:18.198ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25892024-11-07T00:10:18.198ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25902024-11-07T00:10:18.199ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25912024-11-07T00:10:18.199ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25922024-11-07T00:10:18.200ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25932024-11-07T00:10:18.200ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25942024-11-07T00:10:18.201ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25952024-11-07T00:10:18.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25962024-11-07T00:10:28.196ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25972024-11-07T00:10:28.196ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25982024-11-07T00:10:28.197ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
25992024-11-07T00:10:28.198ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26002024-11-07T00:10:28.198ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26012024-11-07T00:10:28.199ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26022024-11-07T00:10:28.200ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26032024-11-07T00:10:28.200ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26042024-11-07T00:10:28.201ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26052024-11-07T00:10:28.201ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26062024-11-07T00:10:28.202ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26072024-11-07T00:10:28.203ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26082024-11-07T00:10:28.203ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26092024-11-07T00:10:28.203ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26102024-11-07T00:10:28.204ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26112024-11-07T00:10:28.204ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26122024-11-07T00:10:28.205ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26132024-11-07T00:10:28.211ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49831
26142024-11-07T00:10:28.211ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49831 req_id = a47eb74e-9898-4abd-88e7-683c86ce5cc7 response_code = 200 uri = /baseboard
26152024-11-07T00:10:28.323ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26162024-11-07T00:10:38.200ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26172024-11-07T00:10:38.201ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26182024-11-07T00:10:38.201ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26192024-11-07T00:10:38.202ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26202024-11-07T00:10:38.203ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26212024-11-07T00:10:38.203ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26222024-11-07T00:10:38.204ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26232024-11-07T00:10:38.204ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26242024-11-07T00:10:38.205ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26252024-11-07T00:10:38.206ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26262024-11-07T00:10:38.206ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26272024-11-07T00:10:38.207ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26282024-11-07T00:10:38.207ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26292024-11-07T00:10:38.208ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26302024-11-07T00:10:38.208ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26312024-11-07T00:10:38.209ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26322024-11-07T00:10:38.209ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26332024-11-07T00:10:38.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26342024-11-07T00:10:42.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65184
26352024-11-07T00:10:42.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65184 req_id = 2b683f2b-f7dd-42d2-a730-f4b76d27c2c5 response_code = 200 uri = /vpc-routes
26362024-11-07T00:10:42.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
26372024-11-07T00:10:42.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65184 req_id = 2a0c3abc-0549-464e-ab41-155f9d48bbec response_code = 204 uri = /eip-gateways
26382024-11-07T00:10:42.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65184 req_id = b91db33c-0158-4ca5-b698-e3d0f42e77bb response_code = 204 uri = /vpc-routes
26392024-11-07T00:10:42.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51336
26402024-11-07T00:10:42.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51336 req_id = ec6df24b-fa34-4fce-9400-5d99b57298e8 response_code = 200 uri = /v2p
26412024-11-07T00:10:42.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54259
26422024-11-07T00:10:42.958ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26432024-11-07T00:10:42.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26442024-11-07T00:10:43.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101718 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54259 req_id = 3688a567-e4a6-486c-bd31-0d8c468671c3 response_code = 204 uri = /switch-ports
26452024-11-07T00:10:43.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54259 req_id = f636dbcb-dfff-450b-9339-c7c1213c2787 response_code = 200 uri = /network-bootstore-config
26462024-11-07T00:10:43.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50851
26472024-11-07T00:10:43.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50851 req_id = 3555e010-bf3e-476c-ba15-eee4a53974c9 response_code = 200 uri = /vpc-routes
26482024-11-07T00:10:43.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
26492024-11-07T00:10:43.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50851 req_id = d3bda7eb-08d3-4f5b-9ff2-857d49a4e19d response_code = 204 uri = /eip-gateways
26502024-11-07T00:10:43.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50851 req_id = b8edcf10-7082-4b3f-8f85-80b9fe6c8be9 response_code = 204 uri = /vpc-routes
26512024-11-07T00:10:43.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38524
26522024-11-07T00:10:43.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38524 req_id = 808aaf29-d42d-4c09-8084-c3b8da78ab6e response_code = 200 uri = /v2p
26532024-11-07T00:10:43.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45768
26542024-11-07T00:10:43.887ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26552024-11-07T00:10:43.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26562024-11-07T00:10:44.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137029 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45768 req_id = 79125f78-ec8b-4cf2-b0a3-d1e6492305b4 response_code = 204 uri = /switch-ports
26572024-11-07T00:10:44.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45768 req_id = 5749659a-5c88-4170-8e10-9c2e6f1d63cc response_code = 200 uri = /network-bootstore-config
26582024-11-07T00:10:44.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58072
26592024-11-07T00:10:44.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58072 req_id = f520257a-e5db-46a5-acc8-2c09724b20ae response_code = 200 uri = /vpc-routes
26602024-11-07T00:10:44.135ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
26612024-11-07T00:10:44.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58072 req_id = 041d6033-e176-47cc-a310-4c97ab734256 response_code = 204 uri = /eip-gateways
26622024-11-07T00:10:44.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58072 req_id = 43900452-b3ee-4cca-84bd-a1140d2704ea response_code = 204 uri = /vpc-routes
26632024-11-07T00:10:44.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63017
26642024-11-07T00:10:44.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63017 req_id = e57a9c5d-8ff9-4838-8162-bea175c88f69 response_code = 200 uri = /v2p
26652024-11-07T00:10:44.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64284
26662024-11-07T00:10:44.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26672024-11-07T00:10:44.472ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26682024-11-07T00:10:44.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115697 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64284 req_id = 0453677c-c90e-4a49-90bb-23dbabe8641e response_code = 204 uri = /switch-ports
26692024-11-07T00:10:44.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64284 req_id = 38c11f2f-6b80-4ae8-acda-d3d5a8dcc5aa response_code = 200 uri = /network-bootstore-config
26702024-11-07T00:10:48.203ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26712024-11-07T00:10:48.204ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26722024-11-07T00:10:48.204ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26732024-11-07T00:10:48.205ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26742024-11-07T00:10:48.206ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26752024-11-07T00:10:48.207ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26762024-11-07T00:10:48.207ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26772024-11-07T00:10:48.208ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26782024-11-07T00:10:48.208ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26792024-11-07T00:10:48.209ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26802024-11-07T00:10:48.210ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26812024-11-07T00:10:48.210ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26822024-11-07T00:10:48.211ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26832024-11-07T00:10:48.211ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26842024-11-07T00:10:48.212ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26852024-11-07T00:10:48.212ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26862024-11-07T00:10:48.213ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26872024-11-07T00:10:48.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26882024-11-07T00:10:58.206ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26892024-11-07T00:10:58.207ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26902024-11-07T00:10:58.208ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26912024-11-07T00:10:58.209ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26922024-11-07T00:10:58.209ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26932024-11-07T00:10:58.210ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26942024-11-07T00:10:58.210ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26952024-11-07T00:10:58.211ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26962024-11-07T00:10:58.212ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26972024-11-07T00:10:58.212ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26982024-11-07T00:10:58.213ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
26992024-11-07T00:10:58.213ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27002024-11-07T00:10:58.214ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27012024-11-07T00:10:58.214ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27022024-11-07T00:10:58.215ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27032024-11-07T00:10:58.215ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27042024-11-07T00:10:58.216ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27052024-11-07T00:10:58.249ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48718
27062024-11-07T00:10:58.249ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48718 req_id = ff6cd0d5-4c78-4534-88ac-4824ff477657 response_code = 200 uri = /baseboard
27072024-11-07T00:10:58.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27082024-11-07T00:11:08.210ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27092024-11-07T00:11:08.210ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27102024-11-07T00:11:08.211ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27112024-11-07T00:11:08.212ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27122024-11-07T00:11:08.213ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27132024-11-07T00:11:08.213ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27142024-11-07T00:11:08.214ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27152024-11-07T00:11:08.214ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27162024-11-07T00:11:08.215ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27172024-11-07T00:11:08.216ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27182024-11-07T00:11:08.216ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27192024-11-07T00:11:08.217ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27202024-11-07T00:11:08.217ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27212024-11-07T00:11:08.218ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27222024-11-07T00:11:08.218ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27232024-11-07T00:11:08.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27242024-11-07T00:11:08.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27252024-11-07T00:11:08.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27262024-11-07T00:11:12.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34028
27272024-11-07T00:11:12.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34028 req_id = 492c1f1d-df25-4822-899e-b8016c8a4580 response_code = 200 uri = /vpc-routes
27282024-11-07T00:11:12.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
27292024-11-07T00:11:12.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34028 req_id = e466d3ad-dd3d-4e31-99ec-4edc7def8c17 response_code = 204 uri = /eip-gateways
27302024-11-07T00:11:12.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34028 req_id = 07c04c3a-db11-4faf-8681-6bb1fb3f01e0 response_code = 204 uri = /vpc-routes
27312024-11-07T00:11:12.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43867
27322024-11-07T00:11:12.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27332024-11-07T00:11:12.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27342024-11-07T00:11:12.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104226 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43867 req_id = a71f1d4c-e94f-4b32-ae03-1a19d43442c6 response_code = 204 uri = /switch-ports
27352024-11-07T00:11:12.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37136
27362024-11-07T00:11:12.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37136 req_id = b8920583-2c2f-468c-ba2e-36267d54bddd response_code = 200 uri = /v2p
27372024-11-07T00:11:12.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43867 req_id = 2ff64140-8f80-4135-a1c8-7577c691b0f9 response_code = 200 uri = /network-bootstore-config
27382024-11-07T00:11:13.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44292
27392024-11-07T00:11:13.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44292 req_id = 6b5b1d7a-6c33-4bc9-8c74-e65393e1180a response_code = 200 uri = /vpc-routes
27402024-11-07T00:11:13.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
27412024-11-07T00:11:13.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44292 req_id = ff5cf421-dccb-4055-bdbe-088bc5122ce6 response_code = 204 uri = /eip-gateways
27422024-11-07T00:11:13.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44292 req_id = 4229c787-14b4-4179-86ce-17005e98bd34 response_code = 204 uri = /vpc-routes
27432024-11-07T00:11:13.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53803
27442024-11-07T00:11:13.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53803 req_id = 1987014c-3995-419f-9cf6-0994b8735e17 response_code = 200 uri = /v2p
27452024-11-07T00:11:13.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55581
27462024-11-07T00:11:13.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27472024-11-07T00:11:13.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27482024-11-07T00:11:13.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55581 req_id = 3ead439c-6a88-400d-8dc9-9d82635c2cdd response_code = 204 uri = /switch-ports
27492024-11-07T00:11:13.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55581 req_id = b1e2f4a6-2ad6-4da5-850a-620166cdb8bd response_code = 200 uri = /network-bootstore-config
27502024-11-07T00:11:13.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41271
27512024-11-07T00:11:13.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41271 req_id = 11234bcd-9d35-491e-a158-a73ef9aacde7 response_code = 200 uri = /v2p
27522024-11-07T00:11:14.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56814
27532024-11-07T00:11:14.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56814 req_id = d44f2740-74da-4449-b4b2-e78f41421530 response_code = 200 uri = /vpc-routes
27542024-11-07T00:11:14.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
27552024-11-07T00:11:14.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56814 req_id = 5e573aaf-b250-456e-8383-0803e53af03b response_code = 204 uri = /eip-gateways
27562024-11-07T00:11:14.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56814 req_id = 722aecc8-7df2-4329-bb82-2d311d55a7f6 response_code = 204 uri = /vpc-routes
27572024-11-07T00:11:14.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64790
27582024-11-07T00:11:14.127ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27592024-11-07T00:11:14.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27602024-11-07T00:11:14.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64790 req_id = f6fc43d1-6e16-4eef-b387-cdd50636d8e8 response_code = 204 uri = /switch-ports
27612024-11-07T00:11:14.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64790 req_id = 2e8505a7-b79f-421e-8053-647c9a4213bb response_code = 200 uri = /network-bootstore-config
27622024-11-07T00:11:18.213ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27632024-11-07T00:11:18.214ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27642024-11-07T00:11:18.215ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27652024-11-07T00:11:18.215ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27662024-11-07T00:11:18.216ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27672024-11-07T00:11:18.217ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27682024-11-07T00:11:18.217ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27692024-11-07T00:11:18.218ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27702024-11-07T00:11:18.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27712024-11-07T00:11:18.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27722024-11-07T00:11:18.220ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27732024-11-07T00:11:18.220ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27742024-11-07T00:11:18.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27752024-11-07T00:11:18.222ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27762024-11-07T00:11:18.222ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27772024-11-07T00:11:18.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27782024-11-07T00:11:18.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27792024-11-07T00:11:18.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
27802024-11-07T00:11:22.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35673
27812024-11-07T00:11:22.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35673 req_id = ba6f8db8-9a1a-44ce-80f5-a7f4e62f58fb response_code = 200 uri = /v2p
27822024-11-07T00:11:22.007ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14631594) }
27832024-11-07T00:11:22.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35673 req_id = 110175f3-5b7f-46de-ac81-a0e12638b648 response_code = 204 uri = /v2p
27842024-11-07T00:11:22.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48462
27852024-11-07T00:11:22.105ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14631594))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4d568cb523f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9598fdd2-7d8d-40fa-b46e-3cd80708d228, read_only_parent: Some(Volume { block_size: 512, id: f3076c9a-4826-461d-8a97-943c4c792bb6, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1d035fac-27cf-4806-a186-e991c0cb72bc, key: Some("0+o0junjWYwns1I+mlOEzfNZnmnXXSYanLAW3qnmN2M="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9598fdd2-7d8d-40fa-b46e-3cd80708d228, key: Some("0x0hlBorObFhlt+yfGM/u/S+tww/D6k99PxvuILaMBA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::16]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4d568cb523f" }] }), cloud_init_bytes: Some(..) } instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 metadata = InstanceMetadata { silo_id: 5f351d8b-0894-447e-9342-5d8d54d46129, project_id: 2681a38b-5bd3-472a-8bca-ed6527c46233 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-07T00:11:22.096197169Z }
27862024-11-07T00:11:22.105ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 migration_id = None propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
27872024-11-07T00:11:22.105ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 migration_id = None propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14631594))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2efc0d31-3bb0-457a-b56b-8d46f3dd2172, kind: Instance { id: f6b22526-4e3d-49fd-a18c-5d97489f5e81 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14631594), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4d568cb523f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9598fdd2-7d8d-40fa-b46e-3cd80708d228, read_only_parent: Some(Volume { block_size: 512, id: f3076c9a-4826-461d-8a97-943c4c792bb6, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1d035fac-27cf-4806-a186-e991c0cb72bc, key: Some("0+o0junjWYwns1I+mlOEzfNZnmnXXSYanLAW3qnmN2M="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9598fdd2-7d8d-40fa-b46e-3cd80708d228, key: Some("0x0hlBorObFhlt+yfGM/u/S+tww/D6k99PxvuILaMBA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::16]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4d568cb523f" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-07T00:11:22.096197169Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27882024-11-07T00:11:22.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11749 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48462 req_id = 0405cf8c-962f-43e1-bded-5abbea1dc29d response_code = 200 uri = /vmms/6bf250a8-7006-4b9b-b891-73f2ba76bd83
27892024-11-07T00:11:22.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65133
27902024-11-07T00:11:22.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65133 req_id = 5edc059d-c3c0-4746-b0dd-832f5488c024 response_code = 200 uri = /vmms/6bf250a8-7006-4b9b-b891-73f2ba76bd83/state
27912024-11-07T00:11:22.192ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14631594 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27922024-11-07T00:11:22.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27932024-11-07T00:11:22.236ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83 file = illumos-utils/src/zone.rs:325 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
27942024-11-07T00:11:22.261ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83 file = illumos-utils/src/zone.rs:363 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
27952024-11-07T00:11:22.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62454
27962024-11-07T00:11:22.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62454 req_id = 0f3ccccd-50c3-4416-9bba-178ec9165664 response_code = 200 uri = /vpc-routes
27972024-11-07T00:11:22.311ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {2efc0d31-3bb0-457a-b56b-8d46f3dd2172: {10.151.2.175: {32a133b6-4db9-46b5-84b3-99271b0efb11}, 10.151.2.176: {32a133b6-4db9-46b5-84b3-99271b0efb11}}} }
27982024-11-07T00:11:23.777ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
27992024-11-07T00:11:23.777ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone file = illumos-utils/src/running_zone.rs:488 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28002024-11-07T00:11:23.975ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 70.488442ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28012024-11-07T00:11:24.069ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 132.850766ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28022024-11-07T00:11:24.223ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 190.191617ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28032024-11-07T00:11:24.431ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 294.980554ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28042024-11-07T00:11:24.746ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 877.523754ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28052024-11-07T00:11:25.637ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 884.962278ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28062024-11-07T00:11:26.535ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 722.71458ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28072024-11-07T00:11:27.272ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 1.437311961s file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 zone = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28082024-11-07T00:11:28.217ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28092024-11-07T00:11:28.217ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28102024-11-07T00:11:28.218ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28112024-11-07T00:11:28.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28122024-11-07T00:11:28.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28132024-11-07T00:11:28.220ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28142024-11-07T00:11:28.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28152024-11-07T00:11:28.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28162024-11-07T00:11:28.222ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28172024-11-07T00:11:28.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28182024-11-07T00:11:28.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28192024-11-07T00:11:28.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28202024-11-07T00:11:28.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28212024-11-07T00:11:28.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28222024-11-07T00:11:28.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28232024-11-07T00:11:28.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28242024-11-07T00:11:28.226ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28252024-11-07T00:11:28.279ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37942
28262024-11-07T00:11:28.279ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37942 req_id = 63599de6-2643-4b3f-9605-dee649d68f04 response_code = 200 uri = /baseboard
28272024-11-07T00:11:28.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28282024-11-07T00:11:28.743ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83 file = sled-agent/src/instance.rs:1787 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28292024-11-07T00:11:28.754ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 64.915326ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28302024-11-07T00:11:28.833ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 123.194447ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28312024-11-07T00:11:28.970ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 188.005448ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28322024-11-07T00:11:29.174ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83") failed: Property not found. retry in 243.235782ms file = illumos-utils/src/svc.rs:36 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28332024-11-07T00:11:29.432ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28342024-11-07T00:11:29.469ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28352024-11-07T00:11:29.611ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28362024-11-07T00:11:29.612ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 69a45541-8490-420b-8636-983c871692fd
28372024-11-07T00:11:29.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7301402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62454 req_id = 3250f506-f7d6-4b45-b7b2-36b4c27fcdf5 response_code = 204 uri = /eip-gateways
28382024-11-07T00:11:29.612ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-07T00:11:29.612703713Z } file = sled-agent/src/instance.rs:780 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28392024-11-07T00:11:29.612ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-07T00:11:29.612703713Z } propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28402024-11-07T00:11:29.612ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-07T00:11:29.612703713Z }, migration_in: None, migration_out: None }
28412024-11-07T00:11:29.659ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-07T00:11:29.659508997Z } file = sled-agent/src/instance.rs:780 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28422024-11-07T00:11:29.659ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T00:11:29.659508997Z } propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28432024-11-07T00:11:29.659ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T00:11:29.659508997Z }, migration_in: None, migration_out: None }
28442024-11-07T00:11:29.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62454 req_id = 4f4c31a7-9ece-4d8c-8b64-0a9093ee19bf response_code = 204 uri = /vpc-routes
28452024-11-07T00:11:38.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28462024-11-07T00:11:38.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28472024-11-07T00:11:38.222ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28482024-11-07T00:11:38.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28492024-11-07T00:11:38.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28502024-11-07T00:11:38.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28512024-11-07T00:11:38.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28522024-11-07T00:11:38.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28532024-11-07T00:11:38.226ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28542024-11-07T00:11:38.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28552024-11-07T00:11:38.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28562024-11-07T00:11:38.228ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28572024-11-07T00:11:38.228ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28582024-11-07T00:11:38.229ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28592024-11-07T00:11:38.229ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28602024-11-07T00:11:38.230ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28612024-11-07T00:11:38.230ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28622024-11-07T00:11:38.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28632024-11-07T00:11:39.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36825
28642024-11-07T00:11:39.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 538 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36825 req_id = 84b07e59-85b7-41a1-94aa-1283525d31dd response_code = 200 uri = /vmms/6bf250a8-7006-4b9b-b891-73f2ba76bd83/state
28652024-11-07T00:11:39.627ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-07T00:11:39.627160944Z } file = sled-agent/src/instance.rs:780 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28662024-11-07T00:11:39.627ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-07T00:11:39.627160944Z } propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28672024-11-07T00:11:39.627ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-07T00:11:39.627160944Z }, migration_in: None, migration_out: None }
28682024-11-07T00:11:39.638ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-07T00:11:39.638689722Z } file = sled-agent/src/instance.rs:780 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28692024-11-07T00:11:39.638ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-07T00:11:39.638689722Z } propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28702024-11-07T00:11:39.638ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28712024-11-07T00:11:39.638ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28722024-11-07T00:11:39.638ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11335053911796812604 n_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28732024-11-07T00:11:39.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28742024-11-07T00:11:39.639ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/4570c3a5-1712-4889-a368-30df2852f980/debug/bundle/zone", "/pool/int/83bc5ff0-ecb5-4e20-a614-41b76e27f040/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3da17e53-d384-4209-aa7d-1c0e0650f28d/crypt/debug", "/pool/ext/737b2345-38a9-43c1-8e04-028013083dab/crypt/debug", "/pool/ext/77b9d04f-ff62-4bf6-80b6-1ba59410cf90/crypt/debug", "/pool/ext/2e9aa741-c339-4c7e-bd6a-302462e9a45d/crypt/debug", "/pool/ext/b526a174-72fc-4230-a1f2-853297828dee/crypt/debug", "/pool/ext/21b357d6-ee4d-46ce-a662-7388891b2eb0/crypt/debug", "/pool/ext/25e5b8a8-6c0f-412b-8992-b44def269af8/crypt/debug", "/pool/ext/ae074693-ac16-4071-b410-16e9a1afa3ad/crypt/debug", "/pool/ext/aa9b2bf5-6331-4c37-9308-cee886ded211/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83
28752024-11-07T00:11:39.639ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 9233882853881366878 n_samples = 6 sled_id = 69a45541-8490-420b-8636-983c871692fd
28762024-11-07T00:11:40.293ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83", bundle_id: 96529d0b-c6b1-42ec-8d01-9e8a05a9bba9 }, time_created: 2024-11-07T00:11:39.639915328Z, version: 0, cause: TerminatedInstance }
28772024-11-07T00:11:40.293ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_6bf250a8-7006-4b9b-b891-73f2ba76bd83 file = sled-agent/src/instance.rs:1032 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28782024-11-07T00:11:42.023ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28792024-11-07T00:11:42.043ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14631594), kind: System }
28802024-11-07T00:11:42.043ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14631594), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28812024-11-07T00:11:42.044ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T00:11:42.044879059Z }, migration_in: None, migration_out: None }
28822024-11-07T00:11:42.069ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T00:11:42.044879059Z }, migration_in: None, migration_out: None }
28832024-11-07T00:11:42.072ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = f6b22526-4e3d-49fd-a18c-5d97489f5e81 propolis_id = 6bf250a8-7006-4b9b-b891-73f2ba76bd83
28842024-11-07T00:11:42.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65260
28852024-11-07T00:11:42.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65260 req_id = f8787163-5969-42ef-920b-a3dbb646e88d response_code = 200 uri = /vpc-routes
28862024-11-07T00:11:42.603ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {2efc0d31-3bb0-457a-b56b-8d46f3dd2172: {10.151.2.176: {32a133b6-4db9-46b5-84b3-99271b0efb11}, 10.151.2.175: {32a133b6-4db9-46b5-84b3-99271b0efb11}}} }
28872024-11-07T00:11:42.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65260 req_id = f92774fc-4d95-4347-a66b-b34b4132a26b response_code = 204 uri = /eip-gateways
28882024-11-07T00:11:42.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65260 req_id = 98e67135-8608-4a24-8891-92b605f6da0f response_code = 204 uri = /vpc-routes
28892024-11-07T00:11:42.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42201
28902024-11-07T00:11:42.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42201 req_id = 532f5bc1-28aa-452b-a836-659594b4b160 response_code = 200 uri = /vpc-routes
28912024-11-07T00:11:42.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48799
28922024-11-07T00:11:42.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48799 req_id = 2a45b97f-d9f3-4cff-be20-392236e32d00 response_code = 200 uri = /v2p
28932024-11-07T00:11:42.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
28942024-11-07T00:11:42.813ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 69a45541-8490-420b-8636-983c871692fd
28952024-11-07T00:11:42.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42201 req_id = ba71756d-e983-4cb3-b592-9d4226301157 response_code = 204 uri = /eip-gateways
28962024-11-07T00:11:42.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42201 req_id = 830ab4f1-2391-49fd-8310-16270cd51efc response_code = 204 uri = /vpc-routes
28972024-11-07T00:11:42.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65327
28982024-11-07T00:11:42.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28992024-11-07T00:11:42.892ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29002024-11-07T00:11:42.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65327 req_id = 9ba458ba-ae12-49be-ad03-8228a09323f8 response_code = 204 uri = /switch-ports
29012024-11-07T00:11:42.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58252
29022024-11-07T00:11:42.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58252 req_id = 9a454f46-dd01-404c-92ca-38cf830e3d02 response_code = 200 uri = /v2p
29032024-11-07T00:11:42.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65327 req_id = 37c9a77b-dad4-4e30-88fa-98f4411578ce response_code = 200 uri = /network-bootstore-config
29042024-11-07T00:11:43.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40745
29052024-11-07T00:11:43.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40745 req_id = 22b35bbc-af73-443b-837e-14e68614b3e6 response_code = 200 uri = /v2p
29062024-11-07T00:11:43.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40922
29072024-11-07T00:11:43.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40922 req_id = 561c34dd-4b0d-431a-bedc-03c2d88d41a4 response_code = 200 uri = /vpc-routes
29082024-11-07T00:11:43.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
29092024-11-07T00:11:43.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40922 req_id = 570da3c4-41d3-4b2a-ae8f-5e062e9655b9 response_code = 204 uri = /eip-gateways
29102024-11-07T00:11:43.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40922 req_id = f71f8ca9-7150-4259-85e2-dd0319c4f960 response_code = 204 uri = /vpc-routes
29112024-11-07T00:11:43.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38926
29122024-11-07T00:11:43.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38926 req_id = 6cb440b0-8c73-4a89-a829-83c5f73b8922 response_code = 200 uri = /vpc-routes
29132024-11-07T00:11:43.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
29142024-11-07T00:11:43.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38926 req_id = 2ee9d022-ec5b-44e7-98d9-5bb1dc47026a response_code = 204 uri = /eip-gateways
29152024-11-07T00:11:43.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38926 req_id = d7008caf-bec4-470e-a6ab-06037f3c95c0 response_code = 204 uri = /vpc-routes
29162024-11-07T00:11:43.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40222
29172024-11-07T00:11:43.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29182024-11-07T00:11:43.922ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29192024-11-07T00:11:44.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144311 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40222 req_id = 4bbfbece-5b11-497a-91a1-e7f150e0b98b response_code = 204 uri = /switch-ports
29202024-11-07T00:11:44.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50355
29212024-11-07T00:11:44.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50355 req_id = b68dab6b-6802-4c7e-836b-4747d5b9f20a response_code = 200 uri = /v2p
29222024-11-07T00:11:44.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40222 req_id = a3929d1c-2f74-4601-8f93-7a1bf1ccd2ff response_code = 200 uri = /network-bootstore-config
29232024-11-07T00:11:44.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43481
29242024-11-07T00:11:44.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43481 req_id = 2152bdb9-df94-4cb7-90b5-c1f78148e3e3 response_code = 200 uri = /vpc-routes
29252024-11-07T00:11:44.067ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
29262024-11-07T00:11:44.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43481 req_id = b3ac2cb5-9f17-431e-b9b2-cafc60314ba6 response_code = 204 uri = /eip-gateways
29272024-11-07T00:11:44.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43481 req_id = c21f5e93-8572-478a-85a7-91abeb1b7c72 response_code = 204 uri = /vpc-routes
29282024-11-07T00:11:44.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65500
29292024-11-07T00:11:44.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65500 req_id = 92013ee5-9acb-4021-9ad3-6c043129b838 response_code = 200 uri = /vpc-routes
29302024-11-07T00:11:44.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 69a45541-8490-420b-8636-983c871692fd values = ExternalIpGatewayMap { mappings: {} }
29312024-11-07T00:11:44.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65500 req_id = 109f5c2f-e0c1-4314-8283-99e7971cf2f2 response_code = 204 uri = /eip-gateways
29322024-11-07T00:11:44.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65500 req_id = a9a6ed56-b868-4b1e-898f-e636006e30c5 response_code = 204 uri = /vpc-routes
29332024-11-07T00:11:44.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39406
29342024-11-07T00:11:44.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39406 req_id = 6af9c1d7-420a-4fba-9077-fea25420376b response_code = 200 uri = /v2p
29352024-11-07T00:11:44.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63833
29362024-11-07T00:11:44.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29372024-11-07T00:11:44.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29382024-11-07T00:11:44.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63833 req_id = e8194873-9406-48bb-b4c3-57d8aa8e4a4a response_code = 204 uri = /switch-ports
29392024-11-07T00:11:44.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63833 req_id = 29f77489-c967-4f50-be23-361350546d38 response_code = 200 uri = /network-bootstore-config