Max level shown:
1 [ Nov 1 22:23:22 Enabled. ]
2 [ Nov 1 22:23:22 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 1 22:23:22 Method "start" exited with status 0. ]
4 [ Nov 1 22:23:22 Rereading configuration. ]
5 [ Nov 1 22:23:22 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-01T22:23:22.722ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-01T22:23:22.722ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-01T22:23:22.773ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-01T22:23:22.773ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-01T22:23:22.888ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-01T22:23:22.897ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-01T22:23:22.905ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-01T22:23:23.506ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-01T22:23:23.646ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-01T22:23:23.646ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-01T22:23:23.646ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-01T22:23:23.646ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-01T22:23:23.647ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-01T22:23:23.647ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-01T22:23:23.650ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-01T22:23:23.650ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-01T22:23:23.650ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-01T22:23:23.650ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-01T22:23:23.650ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-01T22:23:23.650ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-01T22:23:23.650ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-11-01T22:23:23.650ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-01T22:23:23.650ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-01T22:23:23.661ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-01T22:23:23.661ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool)
322024-11-01T22:23:23.758ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal }
332024-11-01T22:23:24.249ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-11-01T22:23:24.249ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-01T22:23:24.249ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-01T22:23:24.249ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-01T22:23:24.249ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-11-01T22:23:24.249ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-01T22:23:24.249ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-01T22:23:24.258ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-01T22:23:24.258ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool)
422024-11-01T22:23:24.345ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal }
432024-11-01T22:23:24.825ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-01T22:23:24.825ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-01T22:23:24.825ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-01T22:23:24.825ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-01T22:23:24.825ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
482024-11-01T22:23:24.825ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-01T22:23:24.825ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-01T22:23:24.825ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-01T22:23:24.825ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-01T22:23:24.825ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-01T22:23:24.825ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
542024-11-01T22:23:24.825ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-01T22:23:24.825ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
602024-11-01T22:23:24.826ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-01T22:23:24.826ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
632024-11-01T22:23:24.826ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-01T22:23:24.826ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
692024-11-01T22:23:24.826ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-01T22:23:24.826ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
782024-11-01T22:23:24.826ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-01T22:23:24.826ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
822024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-11-01T22:23:24.826ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-01T22:23:24.826ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
872024-11-01T22:23:24.826ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-01T22:23:24.826ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
952024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
962024-11-01T22:23:24.826ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-01T22:23:24.826ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-01T22:23:24.826ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992024-11-01T22:23:24.826ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1002024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-01T22:23:24.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-01T22:23:24.826ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1032024-11-01T22:23:24.826ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-01T22:23:24.826ZINFOSledAgent (bootstore): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-01T22:23:24.826ZINFOSledAgent (bootstore): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-01T22:23:24.826ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-01T22:23:24.826ZINFOSledAgent (bootstore): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-01T22:23:24.826ZINFOSledAgent (bootstore): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-01T22:23:24.826ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-01T22:23:24.826ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-01T22:23:24.826ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-01T22:23:24.837ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1132024-11-01T22:23:24.837ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1324, tv_nsec: 675382340 } time_to_next_cleanup = 599.99990776s
1142024-11-01T22:23:24.837ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
1152024-11-01T22:23:24.837ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1162024-11-01T22:23:24.837ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-01T22:23:24.840ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-01T22:23:24.840ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-01T22:23:24.842ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-01T22:23:24.842ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1083
1212024-11-01T22:23:24.842ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-01T22:23:24.843ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-11-01T22:23:24.843ZINFOSledAgent (RSS): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-01T22:23:24.843ZINFOSledAgent (RSS): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-01T22:23:24.843ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1146
1262024-11-01T22:23:24.843ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-11-01T22:23:24.843ZINFOSledAgent (RSS): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-01T22:23:24.843ZINFOSledAgent (RSS): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-01T22:23:24.843ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1188
1302024-11-01T22:23:24.843ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-01T22:23:24.843ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-01T22:23:24.843ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-11-01T22:23:24.843ZINFOSledAgent (RSS): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-01T22:23:24.843ZINFOSledAgent (RSS): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-01T22:23:24.843ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8559b5a7-3301-45c6-8f36-6213ed147b79 (sled), rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-01T22:23:24.843ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1222
1372024-11-01T22:23:24.843ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-01T22:23:24.843ZINFOSledAgent (bootstore): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-01T22:23:24.844ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-01T22:23:24.844ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-01T22:23:24.844ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8559b5a7-3301-45c6-8f36-6213ed147b79 (sled), rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-01T22:23:24.844ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4206
1432024-11-01T22:23:24.845ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4588
1442024-11-01T22:23:24.849ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-01T22:23:24.854ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-01T22:23:24.854ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-01T22:23:24.859ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-01T22:23:24.859ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-01T22:23:24.859ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:45683
1502024-11-01T22:23:24.859ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8559b5a7-3301-45c6-8f36-6213ed147b79 (sled), rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-01T22:23:24.859ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-01T22:23:24.859ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-01T22:23:24.859ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1552024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1562024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-01T22:23:24.859ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1592024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1602024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1612024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1622024-11-01T22:23:24.859ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-01T22:23:24.859ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1642024-11-01T22:23:24.875ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1652024-11-01T22:23:24.896ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-01T22:23:24.913ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-01T22:23:24.920ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1682024-11-01T22:23:24.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1692024-11-01T22:23:24.920ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1702024-11-01T22:23:24.920ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-01T22:23:24.923ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 140.370036ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "119941e7-3853-41c1-b58f-e999d7e6798a", "content-length": "124", "date": "Fri, 01 Nov 2024 22:23:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "119941e7-3853-41c1-b58f-e999d7e6798a" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-01T22:23:24.934ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_de1f5fdd-2bbd-4eb3-94a0-6008b930cced/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-01T22:23:24.957ZINFOSledAgent: successfully created encrypted zvol: name="oxi_de1f5fdd-2bbd-4eb3-94a0-6008b930cced/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-01T22:23:24.957ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_de1f5fdd-2bbd-4eb3-94a0-6008b930cced/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-01T22:23:24.962ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1762024-11-01T22:23:24.962ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-01T22:23:24.962ZINFOSledAgent (BackingFs): Ensuring dataset oxi_de1f5fdd-2bbd-4eb3-94a0-6008b930cced/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-01T22:23:25.050ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792024-11-01T22:23:25.065ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-11-01T22:23:25.066ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 142.0242ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "60dd6544-5efb-4a77-83a3-69f1a415c945", "content-length": "124", "date": "Fri, 01 Nov 2024 22:23:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "60dd6544-5efb-4a77-83a3-69f1a415c945" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-11-01T22:23:25.210ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-01T22:23:25.210ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 212.441015ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "779a770e-dccd-4217-bfd2-53ed2ef9ab2c", "content-length": "124", "date": "Fri, 01 Nov 2024 22:23:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "779a770e-dccd-4217-bfd2-53ed2ef9ab2c" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-01T22:23:25.269ZINFOSledAgent (BackingFs): Mounting oxi_de1f5fdd-2bbd-4eb3-94a0-6008b930cced/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-01T22:23:25.282ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-01T22:23:25.282ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-01T22:23:25.282ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-01T22:23:25.282ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-01T22:23:25.424ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-01T22:23:25.425ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 239.496488ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8eefe0a4-8deb-446b-8327-5fda2bae6f53", "content-length": "124", "date": "Fri, 01 Nov 2024 22:23:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8eefe0a4-8deb-446b-8327-5fda2bae6f53" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-01T22:23:25.665ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-01T22:23:25.666ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 267.437708ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "16ebb4f0-450a-4ea2-84f2-513144263b7b", "content-length": "124", "date": "Fri, 01 Nov 2024 22:23:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "16ebb4f0-450a-4ea2-84f2-513144263b7b" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-01T22:23:25.934ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-01T22:23:25.934ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 294.593477ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "296d1d42-2fe3-413c-9d44-b637fc580e94", "content-length": "124", "date": "Fri, 01 Nov 2024 22:23:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "296d1d42-2fe3-413c-9d44-b637fc580e94" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-01T22:23:26.015ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1952024-11-01T22:23:26.021ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:45571 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1962024-11-01T22:23:26.021ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1972024-11-01T22:23:26.021ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:45571 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1982024-11-01T22:23:26.022ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 345.511183ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
1992024-11-01T22:23:26.023ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2002024-11-01T22:23:26.023ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2012024-11-01T22:23:26.023ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2022024-11-01T22:23:26.023ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-11-01T22:23:26.230ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-11-01T22:23:26.368ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 705.098714ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2052024-11-01T22:23:27.075ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.247056176s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2062024-11-01T22:23:28.323ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.852680512s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2072024-11-01T22:23:28.498ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2082024-11-01T22:23:28.499ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2092024-11-01T22:23:28.499ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2102024-11-01T22:23:28.499ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2112024-11-01T22:23:28.499ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2122024-11-01T22:23:28.499ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2132024-11-01T22:23:28.501ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2142024-11-01T22:23:28.502ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2152024-11-01T22:23:28.502ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='f3786bce-13d3-45c6-95c4-d92d9e1f531e'/> <propval type="astring" name="rack_id" value='361f7171-32b8-4689-88bd-41bdd63c83f9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe70:8632'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='8559b5a7-3301-45c6-8f36-6213ed147b79'/> <propval type="astring" name="rack_id" value='361f7171-32b8-4689-88bd-41bdd63c83f9'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='8559b5a7-3301-45c6-8f36-6213ed147b79'/> <propval type="astring" name="rack_uuid" value='361f7171-32b8-4689-88bd-41bdd63c83f9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='8559b5a7-3301-45c6-8f36-6213ed147b79'/> <propval type="astring" name="rack_uuid" value='361f7171-32b8-4689-88bd-41bdd63c83f9'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-11-01T22:23:28.503ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-11-01T22:23:28.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 58.617854ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-11-01T22:23:28.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 108.664161ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-11-01T22:23:29.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 211.170014ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-01T22:23:29.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 379.38664ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-01T22:23:29.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 540.758585ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-01T22:23:30.178ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.319165887s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2232024-11-01T22:23:30.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 803.191021ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-01T22:23:31.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.271089619s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-01T22:23:32.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.287407617s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-01T22:23:34.494ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8559b5a7-3301-45c6-8f36-6213ed147b79) file = sled-agent/src/nexus.rs:527 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2272024-11-01T22:23:34.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2282024-11-01T22:23:34.530ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2292024-11-01T22:23:34.531ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2302024-11-01T22:23:34.531ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312024-11-01T22:23:34.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2322024-11-01T22:23:34.531ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-11-01T22:23:34.532ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-11-01T22:23:34.532ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352024-11-01T22:23:34.532ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362024-11-01T22:23:34.532ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
2372024-11-01T22:23:34.532ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:45683
2382024-11-01T22:23:34.726ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2392024-11-01T22:23:34.726ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2402024-11-01T22:23:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2412024-11-01T22:23:34.727ZINFOSledAgent (RSS): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2422024-11-01T22:23:34.727ZINFOSledAgent (RSS): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2432024-11-01T22:23:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2442024-11-01T22:23:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2452024-11-01T22:23:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2462024-11-01T22:23:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-11-01T22:23:34.731ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4230 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2482024-11-01T22:23:34.731ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4246
2492024-11-01T22:23:34.731ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2502024-11-01T22:23:34.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61270
2512024-11-01T22:23:34.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2522024-11-01T22:23:34.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2532024-11-01T22:23:34.961ZINFOSledAgent (ServiceManager): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:188
2542024-11-01T22:23:34.961ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:188
2552024-11-01T22:23:34.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61270 req_id = ef7d69ee-b486-48c1-8496-ec2c022cf37e response_code = 200 uri = /inventory
2562024-11-01T22:23:34.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38928
2572024-11-01T22:23:34.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38928 req_id = 781fbdb5-105c-4b2e-b908-6953da2c3263 response_code = 200 uri = /sled-role
2582024-11-01T22:23:34.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2592024-11-01T22:23:34.995ZINFOSledAgent (RSS): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2602024-11-01T22:23:34.995ZINFOSledAgent (RSS): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2612024-11-01T22:23:34.996ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2622024-11-01T22:23:35.025ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 14019aad-b661-46ac-b133-7328720ba1d2, pool_id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f7a4c5d6-20ca-40af-a67c-d93316f002ec, pool_id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f7b74d4b-e237-473e-94b8-8732b05f48ee, pool_id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0f4562c4-89e7-4cfc-ade5-e5f47bc8ec02, pool_id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: cd74d88e-b602-4a28-9315-3c7a77e1aadc, pool_id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 94985df7-a393-440b-ba39-497b5a6c83be, pool_id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e1bf157f-4b20-4908-8daa-9e56397947f8, pool_id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 703bbd5a-763a-49ff-9ce0-c0412536b7b0, pool_id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 42ca2035-a294-4369-82cd-0d253eb3ef03, pool_id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2632024-11-01T22:23:35.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50355
2642024-11-01T22:23:35.025ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:886 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2652024-11-01T22:23:35.025ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 14019aad-b661-46ac-b133-7328720ba1d2, pool_id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f7a4c5d6-20ca-40af-a67c-d93316f002ec, pool_id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f7b74d4b-e237-473e-94b8-8732b05f48ee, pool_id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0f4562c4-89e7-4cfc-ade5-e5f47bc8ec02, pool_id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: cd74d88e-b602-4a28-9315-3c7a77e1aadc, pool_id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 94985df7-a393-440b-ba39-497b5a6c83be, pool_id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e1bf157f-4b20-4908-8daa-9e56397947f8, pool_id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 703bbd5a-763a-49ff-9ce0-c0412536b7b0, pool_id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 42ca2035-a294-4369-82cd-0d253eb3ef03, pool_id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2662024-11-01T22:23:35.025ZINFOSledAgent (StorageManager): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2672024-11-01T22:23:35.025ZINFOSledAgent (StorageManager): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2682024-11-01T22:23:35.025ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2692024-11-01T22:23:35.025ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2702024-11-01T22:23:35.025ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2712024-11-01T22:23:35.025ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2722024-11-01T22:23:35.025ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2732024-11-01T22:23:35.170ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2742024-11-01T22:23:35.170ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 01974938-4423-4d00-8483-e32aa45bba65 (zpool)
2752024-11-01T22:23:35.612ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 7.837419595s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2762024-11-01T22:23:35.613ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8559b5a7-3301-45c6-8f36-6213ed147b79) file = sled-agent/src/probe_manager.rs:231 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2772024-11-01T22:23:36.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 325019536625736035 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2782024-11-01T22:23:36.054ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17323502225304924956 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2792024-11-01T22:23:36.247ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
2802024-11-01T22:23:36.259ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }
2812024-11-01T22:23:36.266ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:225
2822024-11-01T22:23:36.266ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:227
2832024-11-01T22:23:36.266ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2842024-11-01T22:23:36.266ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:233
2852024-11-01T22:23:36.266ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-11-01T22:23:36.267ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-11-01T22:23:36.267ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
2882024-11-01T22:23:36.300ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2892024-11-01T22:23:36.307ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_01974938-4423-4d00-8483-e32aa45bba65/crypt/zone file = sled-storage/src/dataset.rs:288
2902024-11-01T22:23:36.475ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_01974938-4423-4d00-8483-e32aa45bba65 file = sled-storage/src/dataset.rs:374
2912024-11-01T22:23:36.483ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2922024-11-01T22:23:36.483ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2932024-11-01T22:23:36.483ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2942024-11-01T22:23:36.483ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2952024-11-01T22:23:36.483ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2962024-11-01T22:23:36.492ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2972024-11-01T22:23:36.492ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b584fadd-38ce-4107-970b-85f46f61dadb (zpool)
2982024-11-01T22:23:36.583ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }
2992024-11-01T22:23:36.591ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:225
3002024-11-01T22:23:36.591ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:227
3012024-11-01T22:23:36.591ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
3022024-11-01T22:23:36.591ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:233
3032024-11-01T22:23:36.591ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3042024-11-01T22:23:36.591ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3052024-11-01T22:23:36.591ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3062024-11-01T22:23:36.615ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8559b5a7-3301-45c6-8f36-6213ed147b79) file = sled-agent/src/probe_manager.rs:231 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
3072024-11-01T22:23:36.626ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3082024-11-01T22:23:36.634ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b584fadd-38ce-4107-970b-85f46f61dadb/crypt/zone file = sled-storage/src/dataset.rs:288
3092024-11-01T22:23:36.807ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b584fadd-38ce-4107-970b-85f46f61dadb file = sled-storage/src/dataset.rs:374
3102024-11-01T22:23:36.814ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3112024-11-01T22:23:36.814ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3122024-11-01T22:23:36.814ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3132024-11-01T22:23:36.814ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3142024-11-01T22:23:36.814ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3152024-11-01T22:23:36.823ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3162024-11-01T22:23:36.823ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool)
3172024-11-01T22:23:36.915ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }
3182024-11-01T22:23:36.922ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:225
3192024-11-01T22:23:36.922ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:227
3202024-11-01T22:23:36.922ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3212024-11-01T22:23:36.923ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:233
3222024-11-01T22:23:36.923ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3232024-11-01T22:23:36.923ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-01T22:23:36.923ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3252024-11-01T22:23:36.957ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3262024-11-01T22:23:36.966ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crypt/zone file = sled-storage/src/dataset.rs:288
3272024-11-01T22:23:37.131ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256 file = sled-storage/src/dataset.rs:374
3282024-11-01T22:23:37.139ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3292024-11-01T22:23:37.139ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3302024-11-01T22:23:37.139ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3312024-11-01T22:23:37.139ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3322024-11-01T22:23:37.139ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3332024-11-01T22:23:37.149ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3342024-11-01T22:23:37.149ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = db20314d-42b2-4943-87a6-6fa7beadbeba (zpool)
3352024-11-01T22:23:37.241ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }
3362024-11-01T22:23:37.249ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:225
3372024-11-01T22:23:37.249ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:227
3382024-11-01T22:23:37.249ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3392024-11-01T22:23:37.249ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:233
3402024-11-01T22:23:37.249ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3412024-11-01T22:23:37.249ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-11-01T22:23:37.249ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3432024-11-01T22:23:37.285ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3442024-11-01T22:23:37.293ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_db20314d-42b2-4943-87a6-6fa7beadbeba/crypt/zone file = sled-storage/src/dataset.rs:288
3452024-11-01T22:23:37.468ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_db20314d-42b2-4943-87a6-6fa7beadbeba file = sled-storage/src/dataset.rs:374
3462024-11-01T22:23:37.476ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3472024-11-01T22:23:37.476ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3482024-11-01T22:23:37.476ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3492024-11-01T22:23:37.476ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3502024-11-01T22:23:37.476ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3512024-11-01T22:23:37.485ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3522024-11-01T22:23:37.485ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool)
3532024-11-01T22:23:37.582ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }
3542024-11-01T22:23:37.591ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:225
3552024-11-01T22:23:37.591ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:227
3562024-11-01T22:23:37.591ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3572024-11-01T22:23:37.591ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:233
3582024-11-01T22:23:37.591ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3592024-11-01T22:23:37.591ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3602024-11-01T22:23:37.591ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3612024-11-01T22:23:37.617ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8559b5a7-3301-45c6-8f36-6213ed147b79) file = sled-agent/src/probe_manager.rs:231 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
3622024-11-01T22:23:37.626ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3632024-11-01T22:23:37.634ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_97002ab6-ec54-479c-a9fd-59dd0b329ec7/crypt/zone file = sled-storage/src/dataset.rs:288
3642024-11-01T22:23:37.812ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_97002ab6-ec54-479c-a9fd-59dd0b329ec7 file = sled-storage/src/dataset.rs:374
3652024-11-01T22:23:37.820ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3662024-11-01T22:23:37.820ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3672024-11-01T22:23:37.820ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3682024-11-01T22:23:37.820ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3692024-11-01T22:23:37.820ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3702024-11-01T22:23:37.830ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3712024-11-01T22:23:37.830ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool)
3722024-11-01T22:23:37.926ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool), kind: External }
3732024-11-01T22:23:37.933ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:225
3742024-11-01T22:23:37.933ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:227
3752024-11-01T22:23:37.933ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3762024-11-01T22:23:37.933ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:233
3772024-11-01T22:23:37.933ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3782024-11-01T22:23:37.933ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-01T22:23:37.933ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3802024-11-01T22:23:37.968ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3812024-11-01T22:23:37.976ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4084e05d-3d12-4c0d-8aa6-ba2cf8744980/crypt/zone file = sled-storage/src/dataset.rs:288
3822024-11-01T22:23:38.145ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4084e05d-3d12-4c0d-8aa6-ba2cf8744980 file = sled-storage/src/dataset.rs:374
3832024-11-01T22:23:38.153ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3842024-11-01T22:23:38.153ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3852024-11-01T22:23:38.153ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3862024-11-01T22:23:38.153ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3872024-11-01T22:23:38.153ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3882024-11-01T22:23:38.163ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3892024-11-01T22:23:38.163ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool)
3902024-11-01T22:23:38.263ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External }
3912024-11-01T22:23:38.271ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:225
3922024-11-01T22:23:38.271ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:227
3932024-11-01T22:23:38.271ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
3942024-11-01T22:23:38.271ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:233
3952024-11-01T22:23:38.271ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3962024-11-01T22:23:38.271ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-11-01T22:23:38.271ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3982024-11-01T22:23:38.304ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3992024-11-01T22:23:38.312ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7c09bb29-fa72-45dc-9742-d80c9c813ff8/crypt/zone file = sled-storage/src/dataset.rs:288
4002024-11-01T22:23:38.481ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7c09bb29-fa72-45dc-9742-d80c9c813ff8 file = sled-storage/src/dataset.rs:374
4012024-11-01T22:23:38.488ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4022024-11-01T22:23:38.488ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4032024-11-01T22:23:38.488ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4042024-11-01T22:23:38.488ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4052024-11-01T22:23:38.488ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4062024-11-01T22:23:38.498ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4072024-11-01T22:23:38.498ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool)
4082024-11-01T22:23:38.588ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool), kind: External }
4092024-11-01T22:23:38.595ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:225
4102024-11-01T22:23:38.595ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:227
4112024-11-01T22:23:38.595ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4122024-11-01T22:23:38.595ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:233
4132024-11-01T22:23:38.595ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4142024-11-01T22:23:38.595ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4152024-11-01T22:23:38.595ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4162024-11-01T22:23:38.619ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8559b5a7-3301-45c6-8f36-6213ed147b79) file = sled-agent/src/probe_manager.rs:231 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4172024-11-01T22:23:38.628ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4182024-11-01T22:23:38.635ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d8faf4d5-70b3-44f8-a758-7d72b3e12d0a/crypt/zone file = sled-storage/src/dataset.rs:288
4192024-11-01T22:23:38.814ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d8faf4d5-70b3-44f8-a758-7d72b3e12d0a file = sled-storage/src/dataset.rs:374
4202024-11-01T22:23:38.821ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4212024-11-01T22:23:38.821ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4222024-11-01T22:23:38.821ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4232024-11-01T22:23:38.821ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4242024-11-01T22:23:38.821ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4252024-11-01T22:23:38.831ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4262024-11-01T22:23:38.831ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool)
4272024-11-01T22:23:38.931ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool), kind: External }
4282024-11-01T22:23:38.939ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:225
4292024-11-01T22:23:38.939ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:227
4302024-11-01T22:23:38.939ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4312024-11-01T22:23:38.939ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:233
4322024-11-01T22:23:38.939ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4332024-11-01T22:23:38.939ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4342024-11-01T22:23:38.939ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4352024-11-01T22:23:38.975ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4362024-11-01T22:23:38.983ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e70fce64-69d1-485f-8e45-53cfedf62cb4/crypt/zone file = sled-storage/src/dataset.rs:288
4372024-11-01T22:23:39.159ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e70fce64-69d1-485f-8e45-53cfedf62cb4 file = sled-storage/src/dataset.rs:374
4382024-11-01T22:23:39.167ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4392024-11-01T22:23:39.167ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4402024-11-01T22:23:39.167ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4412024-11-01T22:23:39.167ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de1f5fdd-2bbd-4eb3-94a0-6008b930cced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c5f9864-841c-4f7e-9e04-b5d261faabe5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4422024-11-01T22:23:39.167ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4432024-11-01T22:23:39.167ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4442024-11-01T22:23:39.167ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4452024-11-01T22:23:39.168ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:890 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4462024-11-01T22:23:39.168ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4472024-11-01T22:23:39.168ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:916 generation = Generation(1) sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4482024-11-01T22:23:39.168ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:921 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4492024-11-01T22:23:39.168ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:926 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4502024-11-01T22:23:39.168ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4512024-11-01T22:23:39.168ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:932 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4522024-11-01T22:23:39.168ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4532024-11-01T22:23:39.168ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:937 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4542024-11-01T22:23:39.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4142838 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50355 req_id = 44833f2d-1a1c-4f63-b02a-228be909553e response_code = 200 uri = /omicron-physical-disks
4552024-11-01T22:23:39.199ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 15f57006-9470-4df9-8594-2ccba0056607 (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ec080300-45c7-4a57-85a0-2a1237f519d0 (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4562024-11-01T22:23:39.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38990
4572024-11-01T22:23:39.199ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4582024-11-01T22:23:39.199ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4592024-11-01T22:23:39.248ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4602024-11-01T22:23:39.248ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }
4612024-11-01T22:23:39.297ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4622024-11-01T22:23:39.297ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4632024-11-01T22:23:39.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4642024-11-01T22:23:39.345ZINFOSledAgent (ServiceManager): No ledger in /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:188
4652024-11-01T22:23:39.345ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:188
4662024-11-01T22:23:39.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4672024-11-01T22:23:39.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4682024-11-01T22:23:39.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4692024-11-01T22:23:39.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4702024-11-01T22:23:39.440ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607 file = illumos-utils/src/zone.rs:325
4712024-11-01T22:23:39.443ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d file = illumos-utils/src/zone.rs:325
4722024-11-01T22:23:39.447ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0 file = illumos-utils/src/zone.rs:325
4732024-11-01T22:23:39.460ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607 file = illumos-utils/src/zone.rs:363
4742024-11-01T22:23:39.464ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d file = illumos-utils/src/zone.rs:363
4752024-11-01T22:23:39.469ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0 file = illumos-utils/src/zone.rs:363
4762024-11-01T22:23:39.621ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8559b5a7-3301-45c6-8f36-6213ed147b79) file = sled-agent/src/probe_manager.rs:231 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
4772024-11-01T22:23:40.999ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4782024-11-01T22:23:41.484ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4792024-11-01T22:23:41.484ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4802024-11-01T22:23:41.484ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4812024-11-01T22:23:41.963ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4822024-11-01T22:23:41.963ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
4832024-11-01T22:23:41.966ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
4842024-11-01T22:23:41.970ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4852024-11-01T22:23:41.970ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
4862024-11-01T22:23:42.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 72.865239ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
4872024-11-01T22:23:42.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 41.179844ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
4882024-11-01T22:23:42.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 53.639787ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
4892024-11-01T22:23:42.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 95.794213ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
4902024-11-01T22:23:42.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 106.705341ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
4912024-11-01T22:23:42.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 65.615689ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
4922024-11-01T22:23:42.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 212.20511ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
4932024-11-01T22:23:42.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 289.57573ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
4942024-11-01T22:23:42.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 290.628854ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
4952024-11-01T22:23:42.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 458.129881ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
4962024-11-01T22:23:42.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 534.592521ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
4972024-11-01T22:23:42.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 470.211171ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
4982024-11-01T22:23:43.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 973.841745ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
4992024-11-01T22:23:43.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 887.255238ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
5002024-11-01T22:23:43.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 547.753753ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
5012024-11-01T22:23:43.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 1.441817621s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
5022024-11-01T22:23:44.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 614.369476ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
5032024-11-01T22:23:44.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 1.186301205s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
5042024-11-01T22:23:44.496ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10524848830917129635 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
5052024-11-01T22:23:44.496ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7275725321083279316 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
5062024-11-01T22:23:44.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 1.368366421s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
5072024-11-01T22:23:44.809ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4254
5082024-11-01T22:23:44.809ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4264 gateway = fd00:1122:3344:101::1
5092024-11-01T22:23:44.815ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4343
5102024-11-01T22:23:44.908ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4391
5112024-11-01T22:23:44.908ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4418
5122024-11-01T22:23:44.947ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4431
5132024-11-01T22:23:44.947ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4295
5142024-11-01T22:23:45.000ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4337
5152024-11-01T22:23:45.000ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4398 rack_subnet = fd00:1122:3344::
5162024-11-01T22:23:45.019ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4409
5172024-11-01T22:23:45.019ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4451
5182024-11-01T22:23:45.083ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4483
5192024-11-01T22:23:45.083ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4489
5202024-11-01T22:23:45.166ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4530
5212024-11-01T22:23:45.166ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5222024-11-01T22:23:45.198ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 44.722287ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5232024-11-01T22:23:45.244ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 109.93887ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5242024-11-01T22:23:45.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 1.366930443s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
5252024-11-01T22:23:45.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 1.139216292s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
5262024-11-01T22:23:45.356ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5272024-11-01T22:23:45.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:35058
5282024-11-01T22:23:45.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:35058 req_id = f8ca432c-0ed4-40f3-8138-d83e0771f52b response_code = 200 uri = /sled-identifiers
5292024-11-01T22:23:45.388ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5302024-11-01T22:23:45.388ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5312024-11-01T22:23:45.390ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 0
5322024-11-01T22:23:45.390ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5332024-11-01T22:23:45.426ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
5342024-11-01T22:23:45.475ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5352024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5362024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5372024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5382024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5392024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5402024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5412024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5422024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5432024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5442024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5452024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5462024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5472024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5482024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5492024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5502024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5512024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5522024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5532024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5542024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5552024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5562024-11-01T22:23:45.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5572024-11-01T22:23:46.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 724.023958ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
5582024-11-01T22:23:46.055ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 325019536625736035 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
5592024-11-01T22:23:46.055ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17323502225304924956 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
5602024-11-01T22:23:46.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d") failed: Property not found. retry in 1.206533464s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
5612024-11-01T22:23:46.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607") failed: Property not found. retry in 868.286675ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
5622024-11-01T22:23:46.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0") failed: Property not found. retry in 549.148488ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
5632024-11-01T22:23:47.669ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_15f57006-9470-4df9-8594-2ccba0056607
5642024-11-01T22:23:47.669ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_1754c72e-4403-4a3f-a3ff-f405c37e6d5d
5652024-11-01T22:23:47.669ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_ec080300-45c7-4a57-85a0-2a1237f519d0
5662024-11-01T22:23:47.669ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5672024-11-01T22:23:47.669ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5682024-11-01T22:23:47.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8470581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38990 req_id = 51706b19-f29b-43b3-96bc-f8fd87180d2c response_code = 204 uri = /omicron-zones
5692024-11-01T22:23:47.672ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5702024-11-01T22:23:47.702ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 116.156193ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5712024-11-01T22:23:47.837ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5722024-11-01T22:23:47.882ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5732024-11-01T22:23:47.930ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5742024-11-01T22:23:47.930ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5752024-11-01T22:23:47.962ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5762024-11-01T22:23:47.963ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5772024-11-01T22:23:47.963ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5782024-11-01T22:23:47.992ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 15f57006-9470-4df9-8594-2ccba0056607 (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ec080300-45c7-4a57-85a0-2a1237f519d0 (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 1612700a-696e-42f6-98f2-5a5736b8e76b (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 27855a22-7641-4efa-ad86-0884a05b146e, kind: Service { id: 1612700a-696e-42f6-98f2-5a5736b8e76b }, name: Name("ntp-1612700a-696e-42f6-98f2-5a5736b8e76b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 40])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5792024-11-01T22:23:47.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39207
5802024-11-01T22:23:47.992ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5812024-11-01T22:23:47.992ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5822024-11-01T22:23:48.014ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5832024-11-01T22:23:48.014ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }
5842024-11-01T22:23:48.033ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5852024-11-01T22:23:48.033ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5862024-11-01T22:23:48.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5872024-11-01T22:23:48.052ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
5882024-11-01T22:23:48.053ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
5892024-11-01T22:23:48.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5902024-11-01T22:23:48.064ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5912024-11-01T22:23:48.096ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5922024-11-01T22:23:48.097ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5932024-11-01T22:23:48.097ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5942024-11-01T22:23:48.126ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 196, 40]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5952024-11-01T22:23:48.126ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
5962024-11-01T22:23:48.126ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
5972024-11-01T22:23:48.126ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
5982024-11-01T22:23:48.127ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
5992024-11-01T22:23:48.127ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6002024-11-01T22:23:48.150ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b file = illumos-utils/src/zone.rs:325
6012024-11-01T22:23:48.169ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b file = illumos-utils/src/zone.rs:363
6022024-11-01T22:23:48.781ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6032024-11-01T22:23:48.781ZINFOSledAgent (ServiceManager): Booting oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6042024-11-01T22:23:48.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 38.09301ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6052024-11-01T22:23:48.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 65.809998ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6062024-11-01T22:23:49.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 217.678031ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6072024-11-01T22:23:49.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 540.680678ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6082024-11-01T22:23:49.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 702.522673ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6092024-11-01T22:23:50.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 1.147389969s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6102024-11-01T22:23:51.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 508.298658ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6112024-11-01T22:23:52.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 1.171009474s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6122024-11-01T22:23:53.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b") failed: Property not found. retry in 1.464909514s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6132024-11-01T22:23:54.499ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10524848830917129635 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6142024-11-01T22:23:54.499ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7275725321083279316 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6152024-11-01T22:23:54.871ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b
6162024-11-01T22:23:54.871ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6172024-11-01T22:23:54.871ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6182024-11-01T22:23:54.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6879772 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39207 req_id = 8c6eb437-c6eb-469b-9e78-26e8573543c8 response_code = 204 uri = /omicron-zones
6192024-11-01T22:23:54.874ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6202024-11-01T22:23:54.903ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6212024-11-01T22:23:54.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51867
6222024-11-01T22:23:54.912ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6232024-11-01T22:23:54.912ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8685 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51867 req_id = 61e7e2e7-64cc-483e-a6c7-8c23ceefff12 response_code = 500 uri = /timesync
6242024-11-01T22:23:54.913ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6252024-11-01T22:23:55.033ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6262024-11-01T22:23:55.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50731
6272024-11-01T22:23:59.042ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_1612700a-696e-42f6-98f2-5a5736b8e76b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6282024-11-01T22:23:59.042ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50731 req_id = fb858e2a-996c-45fe-962d-2dec468dacea response_code = 500 uri = /timesync
6292024-11-01T22:23:59.044ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16073288477821092302 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6302024-11-01T22:23:59.044ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7634442877311144890 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6312024-11-01T22:23:59.044ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14215770203089540327 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6322024-11-01T22:23:59.044ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 325019536625736035 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6332024-11-01T22:23:59.044ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17323502225304924956 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6342024-11-01T22:23:59.045ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6352024-11-01T22:23:59.243ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6362024-11-01T22:23:59.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61746
6372024-11-01T22:23:59.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61746 req_id = 57becc3b-555c-4b43-9aee-2ff372f4d4e3 response_code = 200 uri = /timesync
6382024-11-01T22:23:59.254ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6392024-11-01T22:23:59.254ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6402024-11-01T22:23:59.444ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6412024-11-01T22:23:59.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46487
6422024-11-01T22:23:59.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46487 req_id = d11b1158-21c8-4f4f-bb0a-0493e4b6dd7a response_code = 200 uri = /timesync
6432024-11-01T22:23:59.454ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6442024-11-01T22:23:59.454ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6452024-11-01T22:23:59.645ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6462024-11-01T22:23:59.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48592
6472024-11-01T22:23:59.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6865 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48592 req_id = 73b4e820-b106-40e0-8f06-43a88e4c537d response_code = 200 uri = /timesync
6482024-11-01T22:23:59.655ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6492024-11-01T22:23:59.655ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6502024-11-01T22:23:59.849ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6512024-11-01T22:23:59.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47694
6522024-11-01T22:23:59.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6415 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47694 req_id = 94f7cd28-3425-4b2b-9792-66bc758a7fa4 response_code = 200 uri = /timesync
6532024-11-01T22:23:59.858ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6542024-11-01T22:23:59.858ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6552024-11-01T22:24:00.239ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6562024-11-01T22:24:00.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59041
6572024-11-01T22:24:00.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8984 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59041 req_id = d3e0ee8a-7b74-4468-9959-25a435351144 response_code = 200 uri = /timesync
6582024-11-01T22:24:00.250ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6592024-11-01T22:24:00.250ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6602024-11-01T22:24:00.663ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6612024-11-01T22:24:00.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43463
6622024-11-01T22:24:00.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8087 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43463 req_id = a55e0603-0535-47bf-8d4f-572a1b3d6165 response_code = 200 uri = /timesync
6632024-11-01T22:24:00.673ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6642024-11-01T22:24:00.673ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6652024-11-01T22:24:00.274ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6662024-11-01T22:24:00.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39298
6672024-11-01T22:24:00.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39298 req_id = 148dfe42-1ab1-47a0-b3e3-69fddb7de84a response_code = 200 uri = /timesync
6682024-11-01T22:24:00.285ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730499838.659552, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6692024-11-01T22:24:00.285ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6702024-11-01T22:24:01.231ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6712024-11-01T22:24:01.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34929
6722024-11-01T22:24:01.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7604 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34929 req_id = 6f49f787-5672-4c37-82ac-a2ad4b85e147 response_code = 200 uri = /timesync
6732024-11-01T22:24:01.242ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730499838.659552, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6742024-11-01T22:24:01.242ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6752024-11-01T22:24:01.605ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6762024-11-01T22:24:01.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45700
6772024-11-01T22:24:01.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45700 req_id = 88af3817-2d11-4e56-833f-962e3142588a response_code = 200 uri = /timesync
6782024-11-01T22:24:01.616ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730499838.659552, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6792024-11-01T22:24:01.616ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6802024-11-01T22:24:02.063ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6812024-11-01T22:24:02.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52018
6822024-11-01T22:24:02.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52018 req_id = 24ae12c3-9a55-421f-8ae7-8b17f6b838c2 response_code = 200 uri = /timesync
6832024-11-01T22:24:02.074ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730499838.659552, correction: 0.042318311 } file = sled-agent/src/rack_setup/service.rs:661
6842024-11-01T22:24:02.074ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6852024-11-01T22:24:03.165ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6862024-11-01T22:24:03.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46456
6872024-11-01T22:24:03.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8091 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46456 req_id = 02939e25-2933-4c5d-8e94-0cb4121f9332 response_code = 200 uri = /timesync
6882024-11-01T22:24:03.177ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730499838.659552, correction: 0.043215454 } file = sled-agent/src/rack_setup/service.rs:661
6892024-11-01T22:24:03.177ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6902024-11-01T22:24:03.250ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 372.614091ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6912024-11-01T22:24:04.260ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6922024-11-01T22:24:04.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47607
6932024-11-01T22:24:04.265ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10524848830917129635 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6942024-11-01T22:24:04.266ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7275725321083279316 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6952024-11-01T22:24:04.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47607 req_id = af987f4d-7520-4d09-b6c1-dec0f9312837 response_code = 200 uri = /timesync
6962024-11-01T22:24:04.270ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730499838.659552, correction: 0.043155011 } file = sled-agent/src/rack_setup/service.rs:661
6972024-11-01T22:24:04.270ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6982024-11-01T22:24:04.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10993862591627199857 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
6992024-11-01T22:24:04.640ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6718015654304753502 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
7002024-11-01T22:24:05.813ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7012024-11-01T22:24:05.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65083
7022024-11-01T22:24:05.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7821 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65083 req_id = c48b9ad7-3371-4643-961e-d5892153e80e response_code = 200 uri = /timesync
7032024-11-01T22:24:05.823ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730499838.659552, correction: 0.034709863 } file = sled-agent/src/rack_setup/service.rs:661
7042024-11-01T22:24:05.823ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7052024-11-01T22:24:07.243ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7062024-11-01T22:24:07.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55630
7072024-11-01T22:24:07.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 21418 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55630 req_id = d4612c05-050b-4b6f-b4fc-a2394506164f response_code = 200 uri = /timesync
7082024-11-01T22:24:07.270ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 861004517, ip_addr: 51.81.226.229, stratum: 3, ref_time: 1730499846.92496, correction: 0.032164477 } file = sled-agent/src/rack_setup/service.rs:661
7092024-11-01T22:24:07.270ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1308
7102024-11-01T22:24:07.300ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 15f57006-9470-4df9-8594-2ccba0056607 (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ec080300-45c7-4a57-85a0-2a1237f519d0 (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 1612700a-696e-42f6-98f2-5a5736b8e76b (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 27855a22-7641-4efa-ad86-0884a05b146e, kind: Service { id: 1612700a-696e-42f6-98f2-5a5736b8e76b }, name: Name("ntp-1612700a-696e-42f6-98f2-5a5736b8e76b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 40])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4b30aaa4-979f-4a86-aa77-66c0f6dc018f (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } } } }, OmicronZoneConfig { id: b5865638-c935-4374-81b5-4b850bea6380 (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } } } }, OmicronZoneConfig { id: aac3a8c4-2c71-42de-bcea-5cc825663c1a (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } } } }, OmicronZoneConfig { id: d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89 (service), filesystem_pool: Some(ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External } } } }, OmicronZoneConfig { id: 4273d4df-a9d9-4251-9d6f-84066c0c30ae (service), filesystem_pool: Some(ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
7112024-11-01T22:24:07.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34332
7122024-11-01T22:24:07.300ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7132024-11-01T22:24:07.300ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7142024-11-01T22:24:07.319ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7152024-11-01T22:24:07.319ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7162024-11-01T22:24:07.339ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7172024-11-01T22:24:07.339ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7182024-11-01T22:24:07.358ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4b30aaa4-979f-4a86-aa77-66c0f6dc018f, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7192024-11-01T22:24:07.358ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4b30aaa4-979f-4a86-aa77-66c0f6dc018f, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7202024-11-01T22:24:07.410ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5865638-c935-4374-81b5-4b850bea6380, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7212024-11-01T22:24:07.410ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: b5865638-c935-4374-81b5-4b850bea6380, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: Cockroach }, responder: ... }
7222024-11-01T22:24:07.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aac3a8c4-2c71-42de-bcea-5cc825663c1a, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7232024-11-01T22:24:07.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: aac3a8c4-2c71-42de-bcea-5cc825663c1a, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7242024-11-01T22:24:07.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89, dataset_name: DatasetName { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7252024-11-01T22:24:07.519ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89, dataset_name: DatasetName { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }, kind: Cockroach }, responder: ... }
7262024-11-01T22:24:07.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4273d4df-a9d9-4251-9d6f-84066c0c30ae, dataset_name: DatasetName { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7272024-11-01T22:24:07.571ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4273d4df-a9d9-4251-9d6f-84066c0c30ae, dataset_name: DatasetName { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7282024-11-01T22:24:07.622ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7292024-11-01T22:24:07.622ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
7302024-11-01T22:24:07.623ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
7312024-11-01T22:24:07.623ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7322024-11-01T22:24:07.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7332024-11-01T22:24:07.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7342024-11-01T22:24:07.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7352024-11-01T22:24:07.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7362024-11-01T22:24:07.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7372024-11-01T22:24:07.796ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f file = illumos-utils/src/zone.rs:325
7382024-11-01T22:24:07.800ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae file = illumos-utils/src/zone.rs:325
7392024-11-01T22:24:07.804ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380 file = illumos-utils/src/zone.rs:325
7402024-11-01T22:24:07.808ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89 file = illumos-utils/src/zone.rs:325
7412024-11-01T22:24:07.813ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a file = illumos-utils/src/zone.rs:325
7422024-11-01T22:24:07.817ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f file = illumos-utils/src/zone.rs:363
7432024-11-01T22:24:07.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae file = illumos-utils/src/zone.rs:363
7442024-11-01T22:24:07.826ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380 file = illumos-utils/src/zone.rs:363
7452024-11-01T22:24:07.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89 file = illumos-utils/src/zone.rs:363
7462024-11-01T22:24:07.834ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a file = illumos-utils/src/zone.rs:363
7472024-11-01T22:24:10.659ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4b30aaa4-979f-4a86-aa77-66c0f6dc018f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7482024-11-01T22:24:10.659ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7492024-11-01T22:24:10.705ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4273d4df-a9d9-4251-9d6f-84066c0c30ae'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7502024-11-01T22:24:10.706ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7512024-11-01T22:24:10.712ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7522024-11-01T22:24:10.712ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='aac3a8c4-2c71-42de-bcea-5cc825663c1a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7532024-11-01T22:24:10.712ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7542024-11-01T22:24:10.717ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7552024-11-01T22:24:10.729ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b5865638-c935-4374-81b5-4b850bea6380'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7562024-11-01T22:24:10.730ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7572024-11-01T22:24:10.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 50.956502ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7582024-11-01T22:24:10.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 59.835656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7592024-11-01T22:24:10.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 46.377267ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7602024-11-01T22:24:10.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 42.055713ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7612024-11-01T22:24:10.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 33.835821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7622024-11-01T22:24:10.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 113.241357ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7632024-11-01T22:24:10.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 139.556201ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7642024-11-01T22:24:11.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 113.452165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7652024-11-01T22:24:11.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 66.214782ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7662024-11-01T22:24:11.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 103.83668ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7672024-11-01T22:24:11.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 123.468121ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7682024-11-01T22:24:11.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 225.371998ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7692024-11-01T22:24:11.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 261.145527ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7702024-11-01T22:24:12.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 210.147402ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7712024-11-01T22:24:12.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 226.069508ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7722024-11-01T22:24:12.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 337.119175ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7732024-11-01T22:24:12.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 293.163649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7742024-11-01T22:24:12.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 221.248497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7752024-11-01T22:24:12.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 434.362548ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7762024-11-01T22:24:12.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 486.168401ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7772024-11-01T22:24:12.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 715.67836ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7782024-11-01T22:24:13.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 975.594153ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7792024-11-01T22:24:13.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 640.579007ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7802024-11-01T22:24:13.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 736.104002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7812024-11-01T22:24:13.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 860.637647ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7822024-11-01T22:24:13.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 1.432469898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7832024-11-01T22:24:13.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 1.460357297s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7842024-11-01T22:24:14.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 1.301785047s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7852024-11-01T22:24:14.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 1.287379654s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7862024-11-01T22:24:14.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 1.092418924s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7872024-11-01T22:24:14.785ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39122
7882024-11-01T22:24:14.785ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39122 req_id = 4b7e39f9-60b5-4055-82d4-e7950ec3b135 response_code = 200 uri = /baseboard
7892024-11-01T22:24:15.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 1.207063686s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7902024-11-01T22:24:15.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 1.446459296s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7912024-11-01T22:24:15.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 881.28291ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7922024-11-01T22:24:15.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 1.196817887s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7932024-11-01T22:24:15.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 659.923707ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7942024-11-01T22:24:16.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 582.706177ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
7952024-11-01T22:24:16.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 1.389957603s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
7962024-11-01T22:24:16.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 793.549045ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
7972024-11-01T22:24:16.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 873.537922ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
7982024-11-01T22:24:16.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 1.407014076s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
7992024-11-01T22:24:16.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 734.915184ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
8002024-11-01T22:24:17.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 1.144398264s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
8012024-11-01T22:24:17.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 973.779272ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
8022024-11-01T22:24:17.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 1.179187801s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
8032024-11-01T22:24:17.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 1.362130196s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
8042024-11-01T22:24:18.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 516.012572ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
8052024-11-01T22:24:18.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 710.144483ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
8062024-11-01T22:24:18.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 665.308015ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
8072024-11-01T22:24:18.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 1.493354559s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
8082024-11-01T22:24:18.701ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 589.64095ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
8092024-11-01T22:24:18.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 961.400011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
8102024-11-01T22:24:19.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 834.53485ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
8112024-11-01T22:24:19.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 1.454116847s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
8122024-11-01T22:24:19.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 1.060974288s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
8132024-11-01T22:24:19.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 848.399878ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
8142024-11-01T22:24:19.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 1.37308161s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
8152024-11-01T22:24:20.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 582.059548ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
8162024-11-01T22:24:20.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 1.284675986s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
8172024-11-01T22:24:20.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 1.157882988s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
8182024-11-01T22:24:20.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 589.799947ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
8192024-11-01T22:24:20.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 1.076718848s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
8202024-11-01T22:24:21.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a") failed: Property not found. retry in 1.257605234s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
8212024-11-01T22:24:21.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 957.371314ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
8222024-11-01T22:24:21.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380") failed: Property not found. retry in 622.153017ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
8232024-11-01T22:24:21.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f") failed: Property not found. retry in 1.03590923s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
8242024-11-01T22:24:21.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89") failed: Property not found. retry in 776.622717ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
8252024-11-01T22:24:22.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae") failed: Property not found. retry in 1.274033717s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
8262024-11-01T22:24:23.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_4b30aaa4-979f-4a86-aa77-66c0f6dc018f
8272024-11-01T22:24:23.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_4273d4df-a9d9-4251-9d6f-84066c0c30ae
8282024-11-01T22:24:23.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_b5865638-c935-4374-81b5-4b850bea6380
8292024-11-01T22:24:23.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89
8302024-11-01T22:24:23.500ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_aac3a8c4-2c71-42de-bcea-5cc825663c1a
8312024-11-01T22:24:23.500ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8322024-11-01T22:24:23.500ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8332024-11-01T22:24:23.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16169400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34332 req_id = f39ac593-43e7-4eb3-84d9-98c076e3b8d0 response_code = 204 uri = /omicron-zones
8342024-11-01T22:24:23.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61019
8352024-11-01T22:24:23.561ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3705
8362024-11-01T22:24:38.419ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3723
8372024-11-01T22:24:48.411ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3746
8382024-11-01T22:24:48.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 24878425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61019 req_id = dd0d6703-28ab-45ae-8e09-7617c88955af response_code = 204 uri = /cockroachdb
8392024-11-01T22:24:48.412ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38455
8402024-11-01T22:24:48.412ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38455 req_id = ca6c79b7-1494-4f21-a8bb-f97009c55866 response_code = 200 uri = /baseboard
8412024-11-01T22:24:48.419ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 824.34506ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
8422024-11-01T22:24:48.450ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 15f57006-9470-4df9-8594-2ccba0056607 (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ec080300-45c7-4a57-85a0-2a1237f519d0 (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 1612700a-696e-42f6-98f2-5a5736b8e76b (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 27855a22-7641-4efa-ad86-0884a05b146e, kind: Service { id: 1612700a-696e-42f6-98f2-5a5736b8e76b }, name: Name("ntp-1612700a-696e-42f6-98f2-5a5736b8e76b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 40])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4b30aaa4-979f-4a86-aa77-66c0f6dc018f (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } } } }, OmicronZoneConfig { id: b5865638-c935-4374-81b5-4b850bea6380 (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } } } }, OmicronZoneConfig { id: aac3a8c4-2c71-42de-bcea-5cc825663c1a (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } } } }, OmicronZoneConfig { id: d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89 (service), filesystem_pool: Some(ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External } } } }, OmicronZoneConfig { id: 4273d4df-a9d9-4251-9d6f-84066c0c30ae (service), filesystem_pool: Some(ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 52d11306-028a-4d00-8d4d-07c571263f67 (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 16f8af4d-7626-4144-90ca-74043fcc6867 (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a (service), filesystem_pool: Some(ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 (service), filesystem_pool: Some(ZpoolName { id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 96b096b4-5564-4c3b-9644-bfe0934f43d1 (service), filesystem_pool: Some(ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 22b674e0-3eb9-4e49-8337-70318d6f88ff (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } } } }, OmicronZoneConfig { id: d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7 (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 22a87c64-b5f1-414c-bb20-41cbf2f4312c (service), filesystem_pool: Some(ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2 (service), filesystem_pool: Some(ZpoolName { id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 2a560f51-82f5-44ab-a728-a3a4e40427d1 (service), filesystem_pool: Some(ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9bc79a3c-96c4-43dd-be36-c8e07e5dc87a (service), filesystem_pool: Some(ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External } } } }, OmicronZoneConfig { id: c20b8f12-9fa0-4960-bcd4-a3d7bde54985 (service), filesystem_pool: Some(ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2fb7fb2b-88d0-4657-a491-de60720d94d1 (service), filesystem_pool: Some(ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External } } } }, OmicronZoneConfig { id: bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89 (service), filesystem_pool: Some(ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 20935250-04c0-47e7-9bc2-fbdc3da1bfce (service), filesystem_pool: Some(ZpoolName { id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool), kind: External } } } }, OmicronZoneConfig { id: 09ed38e6-3420-4f57-9984-10111dfdd5fa (service), filesystem_pool: Some(ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External } } } }, OmicronZoneConfig { id: a660e540-236c-4c74-b940-b40795a7a0a3 (service), filesystem_pool: Some(ZpoolName { id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool), kind: External } } } }, OmicronZoneConfig { id: 3e709b51-34fe-479c-891e-832d08704cf7 (service), filesystem_pool: Some(ZpoolName { id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
8432024-11-01T22:24:48.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52397
8442024-11-01T22:24:48.452ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8452024-11-01T22:24:48.452ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1754c72e-4403-4a3f-a3ff-f405c37e6d5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8462024-11-01T22:24:48.476ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8472024-11-01T22:24:48.476ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 15f57006-9470-4df9-8594-2ccba0056607, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: InternalDns }, responder: ... }
8482024-11-01T22:24:48.496ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8492024-11-01T22:24:48.496ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: ec080300-45c7-4a57-85a0-2a1237f519d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8502024-11-01T22:24:48.515ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4b30aaa4-979f-4a86-aa77-66c0f6dc018f, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8512024-11-01T22:24:48.515ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4b30aaa4-979f-4a86-aa77-66c0f6dc018f, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8522024-11-01T22:24:48.535ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5865638-c935-4374-81b5-4b850bea6380, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8532024-11-01T22:24:48.535ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: b5865638-c935-4374-81b5-4b850bea6380, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: Cockroach }, responder: ... }
8542024-11-01T22:24:48.553ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aac3a8c4-2c71-42de-bcea-5cc825663c1a, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8552024-11-01T22:24:48.553ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: aac3a8c4-2c71-42de-bcea-5cc825663c1a, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8562024-11-01T22:24:48.572ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89, dataset_name: DatasetName { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8572024-11-01T22:24:48.572ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d89f5b7f-9ed7-43c4-ad53-8c5ab41b2a89, dataset_name: DatasetName { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }, kind: Cockroach }, responder: ... }
8582024-11-01T22:24:48.590ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4273d4df-a9d9-4251-9d6f-84066c0c30ae, dataset_name: DatasetName { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8592024-11-01T22:24:48.590ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4273d4df-a9d9-4251-9d6f-84066c0c30ae, dataset_name: DatasetName { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8602024-11-01T22:24:48.608ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 52d11306-028a-4d00-8d4d-07c571263f67, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8612024-11-01T22:24:48.608ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 52d11306-028a-4d00-8d4d-07c571263f67, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8622024-11-01T22:24:48.694ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16f8af4d-7626-4144-90ca-74043fcc6867, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8632024-11-01T22:24:48.694ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 16f8af4d-7626-4144-90ca-74043fcc6867, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8642024-11-01T22:24:48.801ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 22b674e0-3eb9-4e49-8337-70318d6f88ff, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
8652024-11-01T22:24:48.801ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 22b674e0-3eb9-4e49-8337-70318d6f88ff, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8662024-11-01T22:24:48.881ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2a560f51-82f5-44ab-a728-a3a4e40427d1, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8672024-11-01T22:24:48.881ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2a560f51-82f5-44ab-a728-a3a4e40427d1, dataset_name: DatasetName { pool_name: ZpoolName { id: 01974938-4423-4d00-8483-e32aa45bba65 (zpool), kind: External }, kind: Crucible }, responder: ... }
8682024-11-01T22:24:48.954ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9bc79a3c-96c4-43dd-be36-c8e07e5dc87a, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8692024-11-01T22:24:48.954ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 9bc79a3c-96c4-43dd-be36-c8e07e5dc87a, dataset_name: DatasetName { pool_name: ZpoolName { id: b584fadd-38ce-4107-970b-85f46f61dadb (zpool), kind: External }, kind: Crucible }, responder: ... }
8702024-11-01T22:24:49.031ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c20b8f12-9fa0-4960-bcd4-a3d7bde54985, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8712024-11-01T22:24:49.031ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: c20b8f12-9fa0-4960-bcd4-a3d7bde54985, dataset_name: DatasetName { pool_name: ZpoolName { id: 768cd5c9-c954-41f2-a65d-7a379e2ab256 (zpool), kind: External }, kind: Crucible }, responder: ... }
8722024-11-01T22:24:49.110ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2fb7fb2b-88d0-4657-a491-de60720d94d1, dataset_name: DatasetName { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8732024-11-01T22:24:49.110ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2fb7fb2b-88d0-4657-a491-de60720d94d1, dataset_name: DatasetName { pool_name: ZpoolName { id: db20314d-42b2-4943-87a6-6fa7beadbeba (zpool), kind: External }, kind: Crucible }, responder: ... }
8742024-11-01T22:24:49.192ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89, dataset_name: DatasetName { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8752024-11-01T22:24:49.192ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89, dataset_name: DatasetName { pool_name: ZpoolName { id: 97002ab6-ec54-479c-a9fd-59dd0b329ec7 (zpool), kind: External }, kind: Crucible }, responder: ... }
8762024-11-01T22:24:49.264ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 20935250-04c0-47e7-9bc2-fbdc3da1bfce, dataset_name: DatasetName { pool_name: ZpoolName { id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8772024-11-01T22:24:49.264ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 20935250-04c0-47e7-9bc2-fbdc3da1bfce, dataset_name: DatasetName { pool_name: ZpoolName { id: 4084e05d-3d12-4c0d-8aa6-ba2cf8744980 (zpool), kind: External }, kind: Crucible }, responder: ... }
8782024-11-01T22:24:49.326ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 09ed38e6-3420-4f57-9984-10111dfdd5fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8792024-11-01T22:24:49.326ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 09ed38e6-3420-4f57-9984-10111dfdd5fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 7c09bb29-fa72-45dc-9742-d80c9c813ff8 (zpool), kind: External }, kind: Crucible }, responder: ... }
8802024-11-01T22:24:49.391ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a660e540-236c-4c74-b940-b40795a7a0a3, dataset_name: DatasetName { pool_name: ZpoolName { id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8812024-11-01T22:24:49.391ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a660e540-236c-4c74-b940-b40795a7a0a3, dataset_name: DatasetName { pool_name: ZpoolName { id: d8faf4d5-70b3-44f8-a758-7d72b3e12d0a (zpool), kind: External }, kind: Crucible }, responder: ... }
8822024-11-01T22:24:49.454ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e709b51-34fe-479c-891e-832d08704cf7, dataset_name: DatasetName { pool_name: ZpoolName { id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8832024-11-01T22:24:49.454ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3e709b51-34fe-479c-891e-832d08704cf7, dataset_name: DatasetName { pool_name: ZpoolName { id: e70fce64-69d1-485f-8e45-53cfedf62cb4 (zpool), kind: External }, kind: Crucible }, responder: ... }
8842024-11-01T22:24:49.523ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8852024-11-01T22:24:49.523ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
8862024-11-01T22:24:49.524ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
8872024-11-01T22:24:49.524ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8882024-11-01T22:24:49.666ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8892024-11-01T22:24:49.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8902024-11-01T22:24:49.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8912024-11-01T22:24:49.681ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8922024-11-01T22:24:49.681ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8932024-11-01T22:24:49.681ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8942024-11-01T22:24:49.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8952024-11-01T22:24:49.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8962024-11-01T22:24:49.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8972024-11-01T22:24:49.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8982024-11-01T22:24:49.920ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8992024-11-01T22:24:49.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9002024-11-01T22:24:49.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9012024-11-01T22:24:49.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9022024-11-01T22:24:49.947ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9032024-11-01T22:24:49.947ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9042024-11-01T22:24:49.947ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9052024-11-01T22:24:49.948ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9062024-11-01T22:24:49.950ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9072024-11-01T22:24:49.950ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89 file = illumos-utils/src/zone.rs:325
9082024-11-01T22:24:49.954ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985 file = illumos-utils/src/zone.rs:325
9092024-11-01T22:24:49.959ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c file = illumos-utils/src/zone.rs:325
9102024-11-01T22:24:49.964ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7 file = illumos-utils/src/zone.rs:325
9112024-11-01T22:24:49.970ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1 file = illumos-utils/src/zone.rs:325
9122024-11-01T22:24:49.975ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7 file = illumos-utils/src/zone.rs:325
9132024-11-01T22:24:49.980ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3 file = illumos-utils/src/zone.rs:325
9142024-11-01T22:24:49.985ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff file = illumos-utils/src/zone.rs:325
9152024-11-01T22:24:50.108ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89 file = illumos-utils/src/zone.rs:363
9162024-11-01T22:24:50.112ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985 file = illumos-utils/src/zone.rs:363
9172024-11-01T22:24:50.117ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c file = illumos-utils/src/zone.rs:363
9182024-11-01T22:24:50.121ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7 file = illumos-utils/src/zone.rs:363
9192024-11-01T22:24:50.125ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1 file = illumos-utils/src/zone.rs:363
9202024-11-01T22:24:50.130ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7 file = illumos-utils/src/zone.rs:363
9212024-11-01T22:24:50.135ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3 file = illumos-utils/src/zone.rs:363
9222024-11-01T22:24:50.139ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff file = illumos-utils/src/zone.rs:363
9232024-11-01T22:24:50.145ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1 file = illumos-utils/src/zone.rs:325
9242024-11-01T22:24:50.150ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1 file = illumos-utils/src/zone.rs:325
9252024-11-01T22:24:50.156ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a file = illumos-utils/src/zone.rs:325
9262024-11-01T22:24:50.162ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce file = illumos-utils/src/zone.rs:325
9272024-11-01T22:24:50.168ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa file = illumos-utils/src/zone.rs:325
9282024-11-01T22:24:50.175ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2 file = illumos-utils/src/zone.rs:325
9292024-11-01T22:24:50.181ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1 file = illumos-utils/src/zone.rs:363
9302024-11-01T22:24:50.187ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1 file = illumos-utils/src/zone.rs:363
9312024-11-01T22:24:50.193ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a file = illumos-utils/src/zone.rs:363
9322024-11-01T22:24:50.198ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce file = illumos-utils/src/zone.rs:363
9332024-11-01T22:24:50.206ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa file = illumos-utils/src/zone.rs:363
9342024-11-01T22:24:50.212ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2 file = illumos-utils/src/zone.rs:363
9352024-11-01T22:24:50.275ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9362024-11-01T22:24:50.353ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9372024-11-01T22:24:50.463ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9382024-11-01T22:24:50.530ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9392024-11-01T22:24:50.589ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9402024-11-01T22:24:50.591ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9412024-11-01T22:24:50.591ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9422024-11-01T22:24:50.654ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 176, 85]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9432024-11-01T22:24:50.654ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
9442024-11-01T22:24:50.656ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9452024-11-01T22:24:50.656ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9462024-11-01T22:24:50.710ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 202, 195]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9472024-11-01T22:24:50.710ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
9482024-11-01T22:24:50.712ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9492024-11-01T22:24:50.712ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9502024-11-01T22:24:50.765ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 128, 153]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9512024-11-01T22:24:50.765ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9522024-11-01T22:24:50.767ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9532024-11-01T22:24:50.767ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9542024-11-01T22:24:50.825ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 233, 198]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9552024-11-01T22:24:50.826ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9562024-11-01T22:24:50.828ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9572024-11-01T22:24:50.828ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9582024-11-01T22:24:50.884ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 240, 216]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9592024-11-01T22:24:50.884ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9602024-11-01T22:24:50.884ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
9612024-11-01T22:24:50.884ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
9622024-11-01T22:24:50.884ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
9632024-11-01T22:24:50.884ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
9642024-11-01T22:24:50.884ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
9652024-11-01T22:24:50.884ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
9662024-11-01T22:24:50.886ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
9672024-11-01T22:24:50.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9682024-11-01T22:24:50.963ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
9692024-11-01T22:24:50.984ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
9702024-11-01T22:24:50.984ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
9712024-11-01T22:24:50.984ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
9722024-11-01T22:24:50.984ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
9732024-11-01T22:24:50.984ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
9742024-11-01T22:24:50.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9752024-11-01T22:24:51.035ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
9762024-11-01T22:24:51.039ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9772024-11-01T22:24:51.039ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9782024-11-01T22:24:51.039ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
9792024-11-01T22:24:51.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9802024-11-01T22:24:51.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116 file = illumos-utils/src/zone.rs:325
9812024-11-01T22:24:51.124ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67 file = illumos-utils/src/zone.rs:325
9822024-11-01T22:24:51.223ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867 file = illumos-utils/src/zone.rs:325
9832024-11-01T22:24:51.230ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116 file = illumos-utils/src/zone.rs:363
9842024-11-01T22:24:51.237ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67 file = illumos-utils/src/zone.rs:363
9852024-11-01T22:24:51.243ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf file = illumos-utils/src/zone.rs:325
9862024-11-01T22:24:51.251ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a file = illumos-utils/src/zone.rs:325
9872024-11-01T22:24:51.258ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867 file = illumos-utils/src/zone.rs:363
9882024-11-01T22:24:51.277ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf file = illumos-utils/src/zone.rs:363
9892024-11-01T22:24:51.287ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a file = illumos-utils/src/zone.rs:363
9902024-11-01T22:24:53.338ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9912024-11-01T22:24:53.339ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
9922024-11-01T22:24:53.464ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9932024-11-01T22:24:53.464ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
9942024-11-01T22:24:53.503ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d8faf4d5-70b3-44f8-a758-7d72b3e12d0a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d49f376e-4623-47ea-ad83-3021551c63c9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9952024-11-01T22:24:53.503ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
9962024-11-01T22:24:53.554ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7c09bb29-fa72-45dc-9742-d80c9c813ff8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dcdd1d66-27db-4161-87fa-ef34f1a87fec'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9972024-11-01T22:24:53.555ZINFOSledAgent (ServiceManager): Booting oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
9982024-11-01T22:24:53.562ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_db20314d-42b2-4943-87a6-6fa7beadbeba/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b4a03cb5-2c6d-4094-aa5f-43544999bd32'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9992024-11-01T22:24:53.562ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
10002024-11-01T22:24:53.575ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e70fce64-69d1-485f-8e45-53cfedf62cb4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='45321b82-450e-455c-b019-cb107ccff0ac'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10012024-11-01T22:24:53.575ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
10022024-11-01T22:24:53.583ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d8200582-3195-422a-aca9-84bf8be22819'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10032024-11-01T22:24:53.583ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
10042024-11-01T22:24:53.670ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_97002ab6-ec54-479c-a9fd-59dd0b329ec7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2ff0f8d0-0b0a-4707-ba19-8f4375347c1e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10052024-11-01T22:24:53.681ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
10062024-11-01T22:24:53.806ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b584fadd-38ce-4107-970b-85f46f61dadb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d1e44acd-c667-4653-a101-c6f415c85333'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10072024-11-01T22:24:53.806ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
10082024-11-01T22:24:53.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 39.516049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
10092024-11-01T22:24:53.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 27.372349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
10102024-11-01T22:24:53.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 60.095562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
10112024-11-01T22:24:53.858ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='96b096b4-5564-4c3b-9644-bfe0934f43d1'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10122024-11-01T22:24:53.858ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
10132024-11-01T22:24:53.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 64.31525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
10142024-11-01T22:24:53.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 123.493469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
10152024-11-01T22:24:54.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 46.22415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
10162024-11-01T22:24:54.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 39.055403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
10172024-11-01T22:24:54.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 108.264286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
10182024-11-01T22:24:57.462ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4084e05d-3d12-4c0d-8aa6-ba2cf8744980/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='94e4ad7b-4143-4432-8619-99b0365d503a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10192024-11-01T22:24:57.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 102.985199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
10202024-11-01T22:25:01.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 53.654119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
10212024-11-01T22:25:01.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 58.755476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
10222024-11-01T22:25:01.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 43.497506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
10232024-11-01T22:25:02.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 280.597856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
10242024-11-01T22:25:02.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 85.076145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
10252024-11-01T22:25:02.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 57.750564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
10262024-11-01T22:25:02.483ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10272024-11-01T22:25:02.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 165.358037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
10282024-11-01T22:25:02.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 38.655239ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
10292024-11-01T22:25:02.895ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_01974938-4423-4d00-8483-e32aa45bba65/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ce1024db-d514-4bde-92ca-e593ce778f23'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10302024-11-01T22:25:02.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 67.789662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
10312024-11-01T22:25:02.911ZINFOSledAgent (ServiceManager): Booting oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
10322024-11-01T22:25:02.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 112.277936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
10332024-11-01T22:25:03.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 259.938019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
10342024-11-01T22:25:03.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 103.313373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
10352024-11-01T22:25:03.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 103.155529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
10362024-11-01T22:25:03.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 250.298049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
10372024-11-01T22:25:03.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 274.781458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
10382024-11-01T22:25:03.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 167.232421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
10392024-11-01T22:25:03.076ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
10402024-11-01T22:25:03.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 294.329303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
10412024-11-01T22:25:03.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 61.341753ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
10422024-11-01T22:25:03.107ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
10432024-11-01T22:25:03.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 68.201854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
10442024-11-01T22:25:03.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 440.489787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
10452024-11-01T22:25:03.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 217.807907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
10462024-11-01T22:25:03.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 289.309872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
10472024-11-01T22:25:03.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 379.470695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
10482024-11-01T22:25:03.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 225.366926ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
10492024-11-01T22:25:03.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 272.944628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
10502024-11-01T22:25:03.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 452.028109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
10512024-11-01T22:25:03.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.178366877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
10522024-11-01T22:25:03.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 301.365453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
10532024-11-01T22:25:03.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.044359102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
10542024-11-01T22:25:03.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 567.53376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
10552024-11-01T22:25:03.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 73.406467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
10562024-11-01T22:25:03.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 558.073134ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
10572024-11-01T22:25:03.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 27.276784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
10582024-11-01T22:25:03.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 71.126935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
10592024-11-01T22:25:03.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 317.111238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
10602024-11-01T22:25:03.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 75.972663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
10612024-11-01T22:25:03.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 615.813169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
10622024-11-01T22:25:03.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 115.485658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
10632024-11-01T22:25:03.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 432.900813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
10642024-11-01T22:25:03.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 90.771361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
10652024-11-01T22:25:03.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.197985194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
10662024-11-01T22:25:03.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 584.129038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
10672024-11-01T22:25:03.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 296.683818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
10682024-11-01T22:25:03.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 259.821413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
10692024-11-01T22:25:03.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 103.029793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
10702024-11-01T22:25:03.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 834.380152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
10712024-11-01T22:25:03.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.185623051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
10722024-11-01T22:25:03.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 345.682554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
10732024-11-01T22:25:04.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 477.015164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
10742024-11-01T22:25:04.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 357.682949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
10752024-11-01T22:25:04.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 1.179066542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
10762024-11-01T22:25:04.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 1.104347782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
10772024-11-01T22:25:04.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.134500357s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
10782024-11-01T22:25:04.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.184855423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
10792024-11-01T22:25:04.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 619.9795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
10802024-11-01T22:25:04.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.471782816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
10812024-11-01T22:25:04.353ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.134059706s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
10822024-11-01T22:25:04.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 724.312339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
10832024-11-01T22:25:04.396ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10842024-11-01T22:25:04.397ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
10852024-11-01T22:25:04.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.134870833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
10862024-11-01T22:25:04.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.159192174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
10872024-11-01T22:25:04.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.058757145s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
10882024-11-01T22:25:04.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 56.47874ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
10892024-11-01T22:25:04.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 918.469106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
10902024-11-01T22:25:04.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 144.629619ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
10912024-11-01T22:25:04.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 161.769801ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
10922024-11-01T22:25:04.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.164019863s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
10932024-11-01T22:25:04.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.225969262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
10942024-11-01T22:25:05.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 404.693324ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
10952024-11-01T22:25:05.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 734.08546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
10962024-11-01T22:25:05.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 876.85753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
10972024-11-01T22:25:05.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.257501812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
10982024-11-01T22:25:05.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.24293998s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
10992024-11-01T22:25:05.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 1.168537338s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
11002024-11-01T22:25:05.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.433748977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
11012024-11-01T22:25:05.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 612.98669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
11022024-11-01T22:25:05.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 982.708754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
11032024-11-01T22:25:05.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 794.754134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
11042024-11-01T22:25:05.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.125122476s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
11052024-11-01T22:25:05.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 771.198653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
11062024-11-01T22:25:05.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 936.559408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
11072024-11-01T22:25:05.993ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11082024-11-01T22:25:05.993ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11092024-11-01T22:25:05.993ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11102024-11-01T22:25:05.993ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11112024-11-01T22:25:05.998ZINFOSledAgent (ServiceManager): Booting oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11122024-11-01T22:25:06.004ZINFOSledAgent (ServiceManager): Booting oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11132024-11-01T22:25:06.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 1.110644269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
11142024-11-01T22:25:06.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.227301299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
11152024-11-01T22:25:06.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.127990991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
11162024-11-01T22:25:06.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 50.527374ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11172024-11-01T22:25:06.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 64.648626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11182024-11-01T22:25:06.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.220337464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
11192024-11-01T22:25:06.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 607.674626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
11202024-11-01T22:25:06.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 71.152212ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11212024-11-01T22:25:06.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 122.411704ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11222024-11-01T22:25:06.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 93.131277ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11232024-11-01T22:25:06.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 149.951555ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11242024-11-01T22:25:06.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 212.873848ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11252024-11-01T22:25:06.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.349675263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
11262024-11-01T22:25:06.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 101.549449ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11272024-11-01T22:25:06.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 808.300635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
11282024-11-01T22:25:06.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 239.34492ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11292024-11-01T22:25:06.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 255.140632ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11302024-11-01T22:25:06.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 707.036487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
11312024-11-01T22:25:06.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 599.036755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
11322024-11-01T22:25:06.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 940.103624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
11332024-11-01T22:25:06.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 441.095021ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11342024-11-01T22:25:06.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 845.951859ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
11352024-11-01T22:25:06.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.057335728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
11362024-11-01T22:25:06.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 390.69541ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11372024-11-01T22:25:06.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.460780334s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
11382024-11-01T22:25:06.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.036125345s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
11392024-11-01T22:25:06.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.01323466s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11402024-11-01T22:25:06.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.19169769s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
11412024-11-01T22:25:07.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 1.129031259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
11422024-11-01T22:25:07.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 773.029718ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11432024-11-01T22:25:07.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 914.656179ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11442024-11-01T22:25:07.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 574.407653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
11452024-11-01T22:25:07.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.315273783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
11462024-11-01T22:25:07.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 525.412421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
11472024-11-01T22:25:07.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 979.356599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
11482024-11-01T22:25:07.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.04621049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
11492024-11-01T22:25:07.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 773.204329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
11502024-11-01T22:25:07.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.282890671s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
11512024-11-01T22:25:07.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 959.037228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
11522024-11-01T22:25:07.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 997.717634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
11532024-11-01T22:25:07.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.365190236s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
11542024-11-01T22:25:07.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.183282222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
11552024-11-01T22:25:07.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.364415982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
11562024-11-01T22:25:07.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 756.784656ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11572024-11-01T22:25:07.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.408035933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
11582024-11-01T22:25:07.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.1651519s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11592024-11-01T22:25:08.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 888.953638ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11602024-11-01T22:25:08.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 910.171762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
11612024-11-01T22:25:08.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 761.813626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
11622024-11-01T22:25:08.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 891.556879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
11632024-11-01T22:25:08.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 579.070451ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
11642024-11-01T22:25:08.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 616.806159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
11652024-11-01T22:25:08.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.148340188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
11662024-11-01T22:25:08.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.227511502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
11672024-11-01T22:25:08.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 933.446377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
11682024-11-01T22:25:08.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.082815117s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11692024-11-01T22:25:08.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 768.712003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
11702024-11-01T22:25:08.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.356975755s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
11712024-11-01T22:25:08.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 602.356685ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
11722024-11-01T22:25:08.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.379763679s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
11732024-11-01T22:25:09.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.066841758s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11742024-11-01T22:25:09.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.346734957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
11752024-11-01T22:25:09.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 577.883737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
11762024-11-01T22:25:09.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.057557497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
11772024-11-01T22:25:09.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.468465456s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
11782024-11-01T22:25:09.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 1.295808509s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
11792024-11-01T22:25:09.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.207871992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
11802024-11-01T22:25:09.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 696.87173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
11812024-11-01T22:25:09.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 635.910636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
11822024-11-01T22:25:09.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.133738436s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
11832024-11-01T22:25:09.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 888.370709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
11842024-11-01T22:25:09.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.487301874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
11852024-11-01T22:25:09.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 1.477432417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
11862024-11-01T22:25:09.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.241614809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
11872024-11-01T22:25:09.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.474318184s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
11882024-11-01T22:25:09.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 564.265752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
11892024-11-01T22:25:09.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.084814536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
11902024-11-01T22:25:10.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 519.147662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
11912024-11-01T22:25:10.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.215869185s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
11922024-11-01T22:25:10.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 931.046908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
11932024-11-01T22:25:10.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 923.525607ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
11942024-11-01T22:25:10.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.127018796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
11952024-11-01T22:25:10.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.090547497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
11962024-11-01T22:25:10.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.209109091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
11972024-11-01T22:25:10.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 556.177868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
11982024-11-01T22:25:10.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 625.873628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
11992024-11-01T22:25:10.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 1.362974292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12002024-11-01T22:25:10.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.233154578s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
12012024-11-01T22:25:10.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.209011389s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
12022024-11-01T22:25:10.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 829.037764ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
12032024-11-01T22:25:10.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 630.552762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
12042024-11-01T22:25:11.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.444151193s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
12052024-11-01T22:25:11.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.360596171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
12062024-11-01T22:25:11.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.248487891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
12072024-11-01T22:25:11.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 790.740518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
12082024-11-01T22:25:11.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 1.287032114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
12092024-11-01T22:25:11.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.189915914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
12102024-11-01T22:25:11.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.12974394s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
12112024-11-01T22:25:11.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.0516675s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
12122024-11-01T22:25:11.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.417808535s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
12132024-11-01T22:25:11.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.005344641s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
12142024-11-01T22:25:11.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.379061961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
12152024-11-01T22:25:11.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.14511234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
12162024-11-01T22:25:11.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 589.109715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
12172024-11-01T22:25:11.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.275505917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
12182024-11-01T22:25:11.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 959.608993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
12192024-11-01T22:25:11.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.201867376s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
12202024-11-01T22:25:11.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 592.294739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12212024-11-01T22:25:11.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.298357205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
12222024-11-01T22:25:12.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.402667538s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
12232024-11-01T22:25:12.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 951.941618ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
12242024-11-01T22:25:12.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.483751923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
12252024-11-01T22:25:12.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 735.871315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
12262024-11-01T22:25:12.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.044847791s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
12272024-11-01T22:25:12.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 663.308292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
12282024-11-01T22:25:12.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 785.63507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
12292024-11-01T22:25:12.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.262971443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
12302024-11-01T22:25:12.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 845.485165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12312024-11-01T22:25:12.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.423691412s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
12322024-11-01T22:25:12.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.132196039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
12332024-11-01T22:25:12.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.036419713s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
12342024-11-01T22:25:12.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 675.216217ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
12352024-11-01T22:25:12.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.154117426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
12362024-11-01T22:25:12.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 765.165321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
12372024-11-01T22:25:13.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.026583981s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
12382024-11-01T22:25:13.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 564.727239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
12392024-11-01T22:25:13.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.351145729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
12402024-11-01T22:25:13.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 818.769489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
12412024-11-01T22:25:13.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 646.411867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
12422024-11-01T22:25:13.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 641.892886ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
12432024-11-01T22:25:13.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 613.905279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12442024-11-01T22:25:13.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.104942503s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
12452024-11-01T22:25:13.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.352943852s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
12462024-11-01T22:25:13.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.048653631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
12472024-11-01T22:25:13.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 576.815121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
12482024-11-01T22:25:13.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.473495848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
12492024-11-01T22:25:13.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.027330962s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
12502024-11-01T22:25:13.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.040506113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
12512024-11-01T22:25:13.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 533.776447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
12522024-11-01T22:25:13.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 668.731661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
12532024-11-01T22:25:13.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 740.402219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
12542024-11-01T22:25:13.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.187522115s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
12552024-11-01T22:25:13.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.085622991s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
12562024-11-01T22:25:14.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 827.755302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12572024-11-01T22:25:14.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 746.572194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
12582024-11-01T22:25:14.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.262025927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
12592024-11-01T22:25:14.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.271849062s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
12602024-11-01T22:25:14.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 839.720372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
12612024-11-01T22:25:14.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 608.847468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
12622024-11-01T22:25:14.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.072102088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
12632024-11-01T22:25:14.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.122403007s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
12642024-11-01T22:25:14.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 606.746876ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
12652024-11-01T22:25:14.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 892.933139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
12662024-11-01T22:25:14.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 519.648026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
12672024-11-01T22:25:14.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.154528272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
12682024-11-01T22:25:14.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 607.40668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
12692024-11-01T22:25:14.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.464302845s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
12702024-11-01T22:25:14.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 707.400216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12712024-11-01T22:25:14.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.455343685s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
12722024-11-01T22:25:14.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.081726191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
12732024-11-01T22:25:15.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.350481469s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
12742024-11-01T22:25:15.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 879.821371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
12752024-11-01T22:25:15.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.390618925s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
12762024-11-01T22:25:15.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 887.28949ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
12772024-11-01T22:25:15.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.036748482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
12782024-11-01T22:25:15.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.037882557s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
12792024-11-01T22:25:15.324ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12802024-11-01T22:25:15.328ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
12812024-11-01T22:25:15.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 765.706163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
12822024-11-01T22:25:15.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.365528416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
12832024-11-01T22:25:15.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 825.721905ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
12842024-11-01T22:25:15.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.371553174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
12852024-11-01T22:25:15.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 40.226543ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
12862024-11-01T22:25:15.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.343112603s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
12872024-11-01T22:25:15.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 547.179555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12882024-11-01T22:25:15.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 132.639012ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
12892024-11-01T22:25:15.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.084437799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
12902024-11-01T22:25:15.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 297.911576ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
12912024-11-01T22:25:15.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 512.720988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
12922024-11-01T22:25:16.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 1.020547774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
12932024-11-01T22:25:16.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 584.328004ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
12942024-11-01T22:25:16.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 994.378167ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
12952024-11-01T22:25:16.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.029683181s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
12962024-11-01T22:25:16.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 685.597877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
12972024-11-01T22:25:16.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 674.646728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
12982024-11-01T22:25:16.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 537.759722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
12992024-11-01T22:25:16.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 802.921058ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
13002024-11-01T22:25:16.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.363126219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
13012024-11-01T22:25:16.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.021272236s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
13022024-11-01T22:25:16.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.274353866s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
13032024-11-01T22:25:16.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 724.953199ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
13042024-11-01T22:25:16.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.104084731s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
13052024-11-01T22:25:16.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.422892467s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
13062024-11-01T22:25:16.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 563.685776ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
13072024-11-01T22:25:16.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 793.149464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
13082024-11-01T22:25:16.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 597.560109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
13092024-11-01T22:25:16.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 896.613288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
13102024-11-01T22:25:16.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 680.454563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
13112024-11-01T22:25:16.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 669.104666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
13122024-11-01T22:25:16.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.470200983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
13132024-11-01T22:25:16.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 992.225059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
13142024-11-01T22:25:17.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 555.867376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
13152024-11-01T22:25:17.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.269188938s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
13162024-11-01T22:25:17.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 892.439207ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
13172024-11-01T22:25:17.093ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182024-11-01T22:25:17.093ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13192024-11-01T22:25:17.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.215939614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
13202024-11-01T22:25:17.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.446880271s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
13212024-11-01T22:25:17.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 1.345897337s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
13222024-11-01T22:25:17.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 63.520378ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13232024-11-01T22:25:17.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 872.857873ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
13242024-11-01T22:25:17.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 113.043612ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13252024-11-01T22:25:17.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 606.454127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
13262024-11-01T22:25:17.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 237.125013ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13272024-11-01T22:25:17.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 1.009756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
13282024-11-01T22:25:17.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 649.123825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
13292024-11-01T22:25:17.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 765.10231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
13302024-11-01T22:25:17.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 507.877355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
13312024-11-01T22:25:17.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 1.125169684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
13322024-11-01T22:25:17.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.248586778s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
13332024-11-01T22:25:17.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.331587624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
13342024-11-01T22:25:17.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.106025172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
13352024-11-01T22:25:17.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 216.240003ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13362024-11-01T22:25:17.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.361158089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
13372024-11-01T22:25:17.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.449387653s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
13382024-11-01T22:25:17.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 946.146684ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13392024-11-01T22:25:17.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.176860255s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
13402024-11-01T22:25:18.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 595.473401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
13412024-11-01T22:25:18.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.42745359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
13422024-11-01T22:25:18.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 974.85141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
13432024-11-01T22:25:18.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 968.478794ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
13442024-11-01T22:25:18.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.4178245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
13452024-11-01T22:25:18.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 545.340053ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
13462024-11-01T22:25:18.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 851.897167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
13472024-11-01T22:25:18.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 671.961019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
13482024-11-01T22:25:18.487ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62387
13492024-11-01T22:25:18.492ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1636 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62387 req_id = 3d6d667b-07f3-4c8b-9d0d-f54bf8a3b2ce response_code = 200 uri = /baseboard
13502024-11-01T22:25:18.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 672.986244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
13512024-11-01T22:25:18.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 974.807291ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
13522024-11-01T22:25:18.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 516.243984ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
13532024-11-01T22:25:18.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.4212598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
13542024-11-01T22:25:18.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 1.460949068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
13552024-11-01T22:25:18.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.088442514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
13562024-11-01T22:25:18.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 844.867252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
13572024-11-01T22:25:18.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 654.027419ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
13582024-11-01T22:25:18.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 1.380772629s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13592024-11-01T22:25:19.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.024195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
13602024-11-01T22:25:19.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 644.389114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
13612024-11-01T22:25:19.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 517.937726ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
13622024-11-01T22:25:19.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.329446141s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
13632024-11-01T22:25:19.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.13211152s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
13642024-11-01T22:25:19.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.217528506s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
13652024-11-01T22:25:19.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 628.534997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
13662024-11-01T22:25:19.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.098817632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
13672024-11-01T22:25:19.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.01347185s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
13682024-11-01T22:25:19.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 529.437402ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
13692024-11-01T22:25:19.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.033652144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
13702024-11-01T22:25:19.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 1.493733848s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
13712024-11-01T22:25:19.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 557.682288ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
13722024-11-01T22:25:19.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.240855187s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
13732024-11-01T22:25:19.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.245281354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
13742024-11-01T22:25:19.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.072928457s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
13752024-11-01T22:25:19.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 544.851799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
13762024-11-01T22:25:19.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 797.183076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
13772024-11-01T22:25:19.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.003868066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
13782024-11-01T22:25:19.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 690.383241ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
13792024-11-01T22:25:20.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 607.915172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
13802024-11-01T22:25:20.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.325209543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
13812024-11-01T22:25:20.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 654.832606ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
13822024-11-01T22:25:20.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 754.856127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
13832024-11-01T22:25:20.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.497122561s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
13842024-11-01T22:25:20.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 667.444645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
13852024-11-01T22:25:20.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.466135358s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
13862024-11-01T22:25:20.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 1.346125352s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
13872024-11-01T22:25:20.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 1.418982831s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
13882024-11-01T22:25:20.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.409851422s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
13892024-11-01T22:25:20.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 544.461107ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
13902024-11-01T22:25:20.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 549.240995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
13912024-11-01T22:25:20.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 950.089234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
13922024-11-01T22:25:20.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.206077349s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
13932024-11-01T22:25:20.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 571.880308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
13942024-11-01T22:25:20.830ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.703916836s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
13952024-11-01T22:25:20.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 590.740015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
13962024-11-01T22:25:20.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 638.768235ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
13972024-11-01T22:25:20.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.200483069s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
13982024-11-01T22:25:20.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 760.299561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
13992024-11-01T22:25:20.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 649.900701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
14002024-11-01T22:25:21.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 830.719161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
14012024-11-01T22:25:21.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.207160451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
14022024-11-01T22:25:21.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.379469888s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
14032024-11-01T22:25:21.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 1.046602694s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
14042024-11-01T22:25:21.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 920.517817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
14052024-11-01T22:25:21.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 641.488788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
14062024-11-01T22:25:21.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.228619262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
14072024-11-01T22:25:21.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.037963865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
14082024-11-01T22:25:21.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 648.030409ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
14092024-11-01T22:25:21.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 940.380031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
14102024-11-01T22:25:21.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 707.815079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
14112024-11-01T22:25:21.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 622.150651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
14122024-11-01T22:25:21.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.316422886s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
14132024-11-01T22:25:21.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 1.170365273s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
14142024-11-01T22:25:21.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.445605901s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
14152024-11-01T22:25:21.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.477286031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
14162024-11-01T22:25:21.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 896.446207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
14172024-11-01T22:25:21.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 1.499852725s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
14182024-11-01T22:25:21.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 1.338397892s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
14192024-11-01T22:25:21.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 743.75956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
14202024-11-01T22:25:22.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 864.481897ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
14212024-11-01T22:25:22.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 1.399502082s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
14222024-11-01T22:25:22.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 657.006081ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
14232024-11-01T22:25:22.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 826.598133ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
14242024-11-01T22:25:22.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 871.439528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
14252024-11-01T22:25:22.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 595.3188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
14262024-11-01T22:25:22.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 847.738042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
14272024-11-01T22:25:22.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 553.754044ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
14282024-11-01T22:25:22.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.228131897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
14292024-11-01T22:25:22.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 778.578455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
14302024-11-01T22:25:22.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 1.104906633s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
14312024-11-01T22:25:22.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 1.488147121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
14322024-11-01T22:25:22.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 1.433909122s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
14332024-11-01T22:25:22.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1") failed: Property not found. retry in 1.470182992s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
14342024-11-01T22:25:22.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2") failed: Property not found. retry in 854.589558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
14352024-11-01T22:25:22.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7") failed: Property not found. retry in 1.4802277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
14362024-11-01T22:25:23.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 903.841473ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
14372024-11-01T22:25:23.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 1.198269898s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
14382024-11-01T22:25:23.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 852.039388ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
14392024-11-01T22:25:23.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7") failed: Property not found. retry in 1.234879705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
14402024-11-01T22:25:23.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 1.208312428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
14412024-11-01T22:25:23.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 707.196873ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
14422024-11-01T22:25:23.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 951.946725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
14432024-11-01T22:25:23.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c") failed: Property not found. retry in 1.086871813s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
14442024-11-01T22:25:23.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa") failed: Property not found. retry in 1.328311541s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
14452024-11-01T22:25:23.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1") failed: Property not found. retry in 1.187028277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
14462024-11-01T22:25:23.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 741.132933ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
14472024-11-01T22:25:23.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 541.725755ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
14482024-11-01T22:25:23.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3") failed: Property not found. retry in 1.114463222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
14492024-11-01T22:25:23.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 525.188544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
14502024-11-01T22:25:23.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116") failed: Property not found. retry in 1.19874941s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
14512024-11-01T22:25:23.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 1.312865904s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
14522024-11-01T22:25:23.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867") failed: Property not found. retry in 921.440586ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
14532024-11-01T22:25:24.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67") failed: Property not found. retry in 972.38456ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
14542024-11-01T22:25:24.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf") failed: Property not found. retry in 978.374184ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
14552024-11-01T22:25:24.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89") failed: Property not found. retry in 509.97102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
14562024-11-01T22:25:24.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985") failed: Property not found. retry in 776.622712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
14572024-11-01T22:25:24.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a") failed: Property not found. retry in 553.076126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
14582024-11-01T22:25:24.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a") failed: Property not found. retry in 561.344501ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
14592024-11-01T22:25:24.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce") failed: Property not found. retry in 996.333927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
14602024-11-01T22:25:24.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1") failed: Property not found. retry in 578.169303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
14612024-11-01T22:25:25.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff") failed: Property not found. retry in 1.273491406s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
14622024-11-01T22:25:25.762ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.318653112s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
14632024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_bbe72c0e-0778-4c3a-a6f6-d93ed6da9c89
14642024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_c20b8f12-9fa0-4960-bcd4-a3d7bde54985
14652024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_16f8af4d-7626-4144-90ca-74043fcc6867
14662024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_22a87c64-b5f1-414c-bb20-41cbf2f4312c
14672024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_3e709b51-34fe-479c-891e-832d08704cf7
14682024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_7e5351f7-5c9c-48ef-96e0-d88878eeb116
14692024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_2fb7fb2b-88d0-4657-a491-de60720d94d1
14702024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_d8d7cbd8-0fe5-4fda-b30d-d8caa812dfc7
14712024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_a660e540-236c-4c74-b940-b40795a7a0a3
14722024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_22b674e0-3eb9-4e49-8337-70318d6f88ff
14732024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_96b096b4-5564-4c3b-9644-bfe0934f43d1
14742024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_2a560f51-82f5-44ab-a728-a3a4e40427d1
14752024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_9bc79a3c-96c4-43dd-be36-c8e07e5dc87a
14762024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_52d11306-028a-4d00-8d4d-07c571263f67
14772024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_20935250-04c0-47e7-9bc2-fbdc3da1bfce
14782024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_09ed38e6-3420-4f57-9984-10111dfdd5fa
14792024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf
14802024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_b44c0c8a-0647-4c99-9bb4-b2362d0eab3a
14812024-11-01T22:25:26.701ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_6e3c5fcb-b8c6-4e4d-b70f-781e1e40b3c2
14822024-11-01T22:25:26.702ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14832024-11-01T22:25:26.704ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14842024-11-01T22:25:26.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38257474 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52397 req_id = 43f96c22-7311-43e8-a48d-7b495f0b9e4a response_code = 204 uri = /omicron-zones
14852024-11-01T22:25:26.716ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1331
14862024-11-01T22:25:26.717ZINFOSledAgent (RSS): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14872024-11-01T22:25:26.717ZINFOSledAgent (RSS): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14882024-11-01T22:25:26.724ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
14892024-11-01T22:25:26.725ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:720
14902024-11-01T22:25:26.768ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:896
14912024-11-01T22:25:26.772ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14922024-11-01T22:25:26.846ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14932024-11-01T22:25:26.924ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14942024-11-01T22:25:27.083ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14952024-11-01T22:25:27.191ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14962024-11-01T22:25:27.488ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14972024-11-01T22:25:27.822ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14982024-11-01T22:25:28.027ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
14992024-11-01T22:25:28.479ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15002024-11-01T22:25:29.115ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15012024-11-01T22:25:29.879ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15022024-11-01T22:25:30.647ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15032024-11-01T22:25:31.525ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15042024-11-01T22:25:32.283ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15052024-11-01T22:25:32.856ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15062024-11-01T22:25:33.115ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.895453842s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
15072024-11-01T22:25:33.634ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15082024-11-01T22:25:34.625ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/361f7171-32b8-4689-88bd-41bdd63c83f9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15092024-11-01T22:25:36.769ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "ea65341b-f576-4e93-b547-f62b997ca59f", "content-length": "113", "date": "Fri, 01 Nov 2024 22:25:36 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "ea65341b-f576-4e93-b547-f62b997ca59f" } file = sled-agent/src/rack_setup/service.rs:958
15102024-11-01T22:25:38.032ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "91270a07-620a-4ebf-86e1-4d9c6e196897", "content-length": "173", "date": "Fri, 01 Nov 2024 22:25:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"361f7171-32b8-4689-88bd-41bdd63c83f9\"", request_id: "91270a07-620a-4ebf-86e1-4d9c6e196897" } file = sled-agent/src/rack_setup/service.rs:958
15112024-11-01T22:25:40.581ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "afb4dba7-4fac-4342-a732-e0be765f0e48", "content-length": "173", "date": "Fri, 01 Nov 2024 22:25:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8559b5a7-3301-45c6-8f36-6213ed147b79\"", request_id: "afb4dba7-4fac-4342-a732-e0be765f0e48" } file = sled-agent/src/rack_setup/service.rs:958
15122024-11-01T22:25:44.100ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 35.506485641s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"948d630a-ce98-4fd9-9ce8-fa31a0487eaf\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 01 Nov 2024 22:25:43 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"948d630a-ce98-4fd9-9ce8-fa31a0487eaf\\" }" file = oximeter/producer/src/lib.rs:424 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
15132024-11-01T22:25:47.108ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "837dcf8f-99b2-412b-bdb9-5a2d6354cff5", "content-length": "173", "date": "Fri, 01 Nov 2024 22:25:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8559b5a7-3301-45c6-8f36-6213ed147b79\"", request_id: "837dcf8f-99b2-412b-bdb9-5a2d6354cff5" } file = sled-agent/src/rack_setup/service.rs:958
15142024-11-01T22:25:48.539ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43603
15152024-11-01T22:25:48.539ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43603 req_id = 21263180-7ce2-4d9c-a5b8-f56ac0559640 response_code = 200 uri = /baseboard
15162024-11-01T22:25:51.365ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "37d0dc83-0498-467d-9d1c-4f4c27dbb158", "content-length": "173", "date": "Fri, 01 Nov 2024 22:25:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8559b5a7-3301-45c6-8f36-6213ed147b79\"", request_id: "37d0dc83-0498-467d-9d1c-4f4c27dbb158" } file = sled-agent/src/rack_setup/service.rs:958
15172024-11-01T22:25:55.597ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ede7ce2b-1c67-4773-8bf5-7a403d24e75c", "content-length": "173", "date": "Fri, 01 Nov 2024 22:25:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8559b5a7-3301-45c6-8f36-6213ed147b79\"", request_id: "ede7ce2b-1c67-4773-8bf5-7a403d24e75c" } file = sled-agent/src/rack_setup/service.rs:958
15182024-11-01T22:26:01.399ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e81ffb17-3640-46ce-bb23-1cb529ea114a", "content-length": "173", "date": "Fri, 01 Nov 2024 22:26:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8559b5a7-3301-45c6-8f36-6213ed147b79\"", request_id: "e81ffb17-3640-46ce-bb23-1cb529ea114a" } file = sled-agent/src/rack_setup/service.rs:958
15192024-11-01T22:26:05.258ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
15202024-11-01T22:26:05.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40722
15212024-11-01T22:26:05.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15222024-11-01T22:26:05.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15232024-11-01T22:26:05.455ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
15242024-11-01T22:26:05.458ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
15252024-11-01T22:26:05.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40722 req_id = 83289e7d-ba90-4080-b088-c155f2c2e93a response_code = 200 uri = /inventory
15262024-11-01T22:26:08.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63209
15272024-11-01T22:26:08.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 938 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63209 req_id = 4887d164-0f63-455e-92d4-c5c8469e0102 response_code = 200 uri = /vpc-routes
15282024-11-01T22:26:08.603ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
15292024-11-01T22:26:08.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63209 req_id = 2d67dab7-2af9-4b37-bed8-90a1ae874593 response_code = 204 uri = /eip-gateways
15302024-11-01T22:26:08.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41286
15312024-11-01T22:26:08.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41286 req_id = ea31669e-0dea-426c-afb5-6f1d8957f3f2 response_code = 200 uri = /vpc-routes
15322024-11-01T22:26:08.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40948
15332024-11-01T22:26:08.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40948 req_id = dc6acab3-46d9-4017-91e7-1bdfae1a94d5 response_code = 200 uri = /v2p
15342024-11-01T22:26:08.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35366
15352024-11-01T22:26:08.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35366 req_id = 8c6e4ea7-a735-433d-9a86-359cdbed2a50 response_code = 200 uri = /v2p
15362024-11-01T22:26:08.733ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
15372024-11-01T22:26:08.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41286 req_id = 5d69c853-208d-46fd-a04b-b88ea84749a1 response_code = 204 uri = /eip-gateways
15382024-11-01T22:26:08.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52030
15392024-11-01T22:26:08.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52030 req_id = 7d5f1b74-2e0b-45c2-94ea-eda17b9da1c5 response_code = 200 uri = /vpc-routes
15402024-11-01T22:26:08.846ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
15412024-11-01T22:26:08.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52030 req_id = 4450d2ae-8a5e-483d-8d43-2e0a75c34fce response_code = 204 uri = /eip-gateways
15422024-11-01T22:26:08.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56176
15432024-11-01T22:26:08.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56176 req_id = 565d4108-5c4f-4526-91fd-7107d24615e5 response_code = 200 uri = /v2p
15442024-11-01T22:26:08.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7036 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63209 req_id = f6f3407e-0c8b-412b-930a-0973c67917b9 response_code = 204 uri = /vpc-routes
15452024-11-01T22:26:09.350ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
15462024-11-01T22:26:09.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41286 req_id = e0c70928-0e9d-45f2-8b86-c08ba5e3dae5 response_code = 204 uri = /vpc-routes
15472024-11-01T22:26:09.396ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
15482024-11-01T22:26:09.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 484 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52030 req_id = d2cb5b55-aeb1-4272-ad04-ac398c9724b4 response_code = 204 uri = /vpc-routes
15492024-11-01T22:26:09.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62679
15502024-11-01T22:26:09.488ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15512024-11-01T22:26:09.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15522024-11-01T22:26:09.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15532024-11-01T22:26:09.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15542024-11-01T22:26:09.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15552024-11-01T22:26:09.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15562024-11-01T22:26:09.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15572024-11-01T22:26:09.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1464 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62679 req_id = 82c12d8e-ce06-41c2-8e45-cc37b63ce5f8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15582024-11-01T22:26:09.490ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:968
15592024-11-01T22:26:09.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42934
15602024-11-01T22:26:09.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15612024-11-01T22:26:09.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15622024-11-01T22:26:09.748ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
15632024-11-01T22:26:09.749ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
15642024-11-01T22:26:09.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42934 req_id = df9901d2-72f1-45ae-b14b-a864aef84777 response_code = 200 uri = /inventory
15652024-11-01T22:26:10.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47421
15662024-11-01T22:26:10.471ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15672024-11-01T22:26:10.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15682024-11-01T22:26:10.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15692024-11-01T22:26:10.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15702024-11-01T22:26:10.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15712024-11-01T22:26:10.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15722024-11-01T22:26:10.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15732024-11-01T22:26:10.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47421 req_id = 9d2bb4ff-a744-4502-9c55-6b9a47e84699 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15742024-11-01T22:26:10.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64724
15752024-11-01T22:26:10.528ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15762024-11-01T22:26:10.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15772024-11-01T22:26:10.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15782024-11-01T22:26:10.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15792024-11-01T22:26:10.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15802024-11-01T22:26:10.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15812024-11-01T22:26:10.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15822024-11-01T22:26:10.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64724 req_id = 39977f7c-3e5a-4727-8042-1d6bf252bdec response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15832024-11-01T22:26:11.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34388
15842024-11-01T22:26:11.007ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15852024-11-01T22:26:11.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15862024-11-01T22:26:11.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15872024-11-01T22:26:11.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15882024-11-01T22:26:11.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15892024-11-01T22:26:11.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15902024-11-01T22:26:11.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15912024-11-01T22:26:11.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34388 req_id = 5bf86659-8916-418a-9517-2dcf07d9e6aa response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15922024-11-01T22:26:16.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61760
15932024-11-01T22:26:16.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61760 req_id = 6699fccb-8a0d-4b73-a8cc-30812014c88d response_code = 200 uri = /vpc-routes
15942024-11-01T22:26:16.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
15952024-11-01T22:26:16.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61760 req_id = abd56407-3315-44da-9c8a-bc347a03e7bc response_code = 204 uri = /eip-gateways
15962024-11-01T22:26:16.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61760 req_id = 0930d0ad-6d4b-40bf-9427-0d4db33a041d response_code = 204 uri = /vpc-routes
15972024-11-01T22:26:18.574ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42207
15982024-11-01T22:26:18.574ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42207 req_id = 77a99686-2ba0-40cc-9055-52017f31687f response_code = 200 uri = /baseboard
15992024-11-01T22:26:33.222ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:45571 remote_addr = [fd00:1122:3344:101::d]:64183 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
16002024-11-01T22:26:33.256ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32529 local_addr = [fd00:1122:3344:101::1]:45571 method = GET remote_addr = [fd00:1122:3344:101::d]:64183 req_id = 29ae834b-d88b-4537-8047-c2bdc9265eaa response_code = 200 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 uri = /8559b5a7-3301-45c6-8f36-6213ed147b79
16012024-11-01T22:26:38.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47161
16022024-11-01T22:26:38.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47161 req_id = 8b6b01d6-399e-4de8-948c-2c25c930997a response_code = 200 uri = /vpc-routes
16032024-11-01T22:26:38.770ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16042024-11-01T22:26:38.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47161 req_id = 75b0db9b-cfac-4ced-ba74-6988e0131f13 response_code = 204 uri = /eip-gateways
16052024-11-01T22:26:38.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65010
16062024-11-01T22:26:38.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65010 req_id = cd77720f-1128-4449-b527-6abef98f642b response_code = 200 uri = /v2p
16072024-11-01T22:26:38.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47161 req_id = b397dd7c-e91b-4346-84b2-86ef9808e99a response_code = 204 uri = /vpc-routes
16082024-11-01T22:26:38.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46984
16092024-11-01T22:26:38.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46984 req_id = af6a36aa-415d-484e-919c-1eee46f166ff response_code = 200 uri = /vpc-routes
16102024-11-01T22:26:38.900ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16112024-11-01T22:26:38.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46984 req_id = b19838aa-890d-42f4-a149-6e39dd98ec81 response_code = 204 uri = /eip-gateways
16122024-11-01T22:26:38.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46984 req_id = c22fe2eb-23df-45e8-9059-ef573612198a response_code = 204 uri = /vpc-routes
16132024-11-01T22:26:39.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48759
16142024-11-01T22:26:39.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48759 req_id = eefd647b-c1ea-4b34-97ff-f11cf8b8ba14 response_code = 200 uri = /vpc-routes
16152024-11-01T22:26:39.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60226
16162024-11-01T22:26:39.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60226 req_id = 7802109a-eaef-4962-a966-52ee00165818 response_code = 200 uri = /v2p
16172024-11-01T22:26:39.119ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16182024-11-01T22:26:39.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48759 req_id = 91a6a614-4ebc-434b-91b6-45580afbc550 response_code = 204 uri = /eip-gateways
16192024-11-01T22:26:39.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64281
16202024-11-01T22:26:39.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16212024-11-01T22:26:39.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16222024-11-01T22:26:39.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64281 req_id = e84a29e1-24ab-495b-af9c-16bc36bd1c0a response_code = 204 uri = /switch-ports
16232024-11-01T22:26:39.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63091
16242024-11-01T22:26:39.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41557
16252024-11-01T22:26:39.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37537
16262024-11-01T22:26:39.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48759 req_id = 9be25872-460c-4866-a1cd-1e065e6c245b response_code = 204 uri = /vpc-routes
16272024-11-01T22:26:39.319ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16282024-11-01T22:26:39.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64281 req_id = b8fd8ea2-40e9-475e-97af-4a6d6a02406c response_code = 200 uri = /network-bootstore-config
16292024-11-01T22:26:39.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 579 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41557 req_id = 9a26391d-98e5-4d6e-8613-dc41b8ea8655 response_code = 200 uri = /v2p
16302024-11-01T22:26:39.355ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16312024-11-01T22:26:39.355ZINFOSledAgent (bootstore): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16322024-11-01T22:26:39.356ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16332024-11-01T22:26:39.357ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16342024-11-01T22:26:39.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4717 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64281 req_id = 3e0c4b62-0844-4731-a0f3-37bece04e044 response_code = 204 uri = /network-bootstore-config
16352024-11-01T22:26:39.362ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16362024-11-01T22:26:39.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16372024-11-01T22:26:39.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63091 req_id = 4f17393d-7c56-48c2-a5a9-edf1e37c517c response_code = 204 uri = /switch-ports
16382024-11-01T22:26:39.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 896 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63091 req_id = e9cd5b9d-7bd2-4036-85d6-759c014b183e response_code = 200 uri = /network-bootstore-config
16392024-11-01T22:26:39.468ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16402024-11-01T22:26:39.476ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16412024-11-01T22:26:39.476ZINFOSledAgent (bootstore): Writing ledger to /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16422024-11-01T22:26:39.477ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16432024-11-01T22:26:39.477ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16442024-11-01T22:26:39.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 723 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63091 req_id = aac53ab2-e2b8-4ac4-9d88-93911fa0fa09 response_code = 204 uri = /network-bootstore-config
16452024-11-01T22:26:39.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37537 req_id = b2c5cccc-0fbd-46a7-90e1-b7c1bc04d9e4 response_code = 204 uri = /switch-ports
16462024-11-01T22:26:39.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37537 req_id = 673ea3c1-e94f-41c8-99e6-568d488a06ba response_code = 200 uri = /network-bootstore-config
16472024-11-01T22:26:48.608ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61842
16482024-11-01T22:26:48.608ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61842 req_id = fa7db818-afb6-455a-8238-627b97d33443 response_code = 200 uri = /baseboard
16492024-11-01T22:27:08.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62805
16502024-11-01T22:27:08.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62805 req_id = c55649e2-1de1-44df-a35d-be7d0e8f3a37 response_code = 200 uri = /vpc-routes
16512024-11-01T22:27:08.669ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16522024-11-01T22:27:08.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62805 req_id = c790dbe7-f830-4237-b9db-692f18b10b7e response_code = 204 uri = /eip-gateways
16532024-11-01T22:27:08.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46456
16542024-11-01T22:27:08.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46456 req_id = 1703b900-441b-4b2a-8458-23d48022e9f3 response_code = 200 uri = /v2p
16552024-11-01T22:27:08.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57133
16562024-11-01T22:27:08.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57133 req_id = 2eceb348-ee22-41e8-9e46-62a901866e78 response_code = 200 uri = /vpc-routes
16572024-11-01T22:27:08.755ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16582024-11-01T22:27:08.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57133 req_id = 6061724a-b7d4-46d1-9f07-4307b90b84d5 response_code = 204 uri = /eip-gateways
16592024-11-01T22:27:08.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40117
16602024-11-01T22:27:08.759ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16612024-11-01T22:27:08.801ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16622024-11-01T22:27:08.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101297 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40117 req_id = 8f294b55-42eb-45c8-bb02-b9562d21e0de response_code = 204 uri = /switch-ports
16632024-11-01T22:27:08.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58210
16642024-11-01T22:27:08.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40117 req_id = a12c8c5d-4d80-4c31-9a11-0d6360f13ae6 response_code = 200 uri = /network-bootstore-config
16652024-11-01T22:27:08.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58210 req_id = 1fd2cdb2-8d11-4c42-8df3-cb6f89295a07 response_code = 200 uri = /v2p
16662024-11-01T22:27:08.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57133 req_id = f250d26e-8eb4-40cb-9c9b-cdcd8b27b327 response_code = 204 uri = /vpc-routes
16672024-11-01T22:27:08.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62805 req_id = 78e0cded-357c-4974-998e-1415e3236257 response_code = 204 uri = /vpc-routes
16682024-11-01T22:27:08.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43862
16692024-11-01T22:27:08.896ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16702024-11-01T22:27:08.941ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16712024-11-01T22:27:09.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43862 req_id = 2bcc6aaa-f652-4534-9dcc-569b5426b41b response_code = 204 uri = /switch-ports
16722024-11-01T22:27:09.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56891
16732024-11-01T22:27:09.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64614
16742024-11-01T22:27:09.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64614 req_id = e8761b2c-da84-48e8-bc08-f15aa05fb30b response_code = 200 uri = /vpc-routes
16752024-11-01T22:27:09.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43862 req_id = 6767eb8b-5899-4281-956e-d3bf246de1c5 response_code = 200 uri = /network-bootstore-config
16762024-11-01T22:27:09.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56891 req_id = c2b2c0ee-4ced-4f08-b5c8-e237ce2c944a response_code = 200 uri = /v2p
16772024-11-01T22:27:09.017ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16782024-11-01T22:27:09.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64614 req_id = f899eab1-6d78-491c-86c7-e7cd882acaf8 response_code = 204 uri = /eip-gateways
16792024-11-01T22:27:09.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64614 req_id = 37445f10-c9e7-4694-b982-c2f6b70c9929 response_code = 204 uri = /vpc-routes
16802024-11-01T22:27:09.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43262
16812024-11-01T22:27:09.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16822024-11-01T22:27:09.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16832024-11-01T22:27:09.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103403 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43262 req_id = 24260aa1-1789-46fa-a7f4-206c6ffe179c response_code = 204 uri = /switch-ports
16842024-11-01T22:27:09.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43262 req_id = f381f307-776d-4e89-ae6c-19c11f9f41ee response_code = 200 uri = /network-bootstore-config
16852024-11-01T22:27:18.644ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60446
16862024-11-01T22:27:18.644ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60446 req_id = a0fc980f-0125-4cd5-ae8f-60b580019b45 response_code = 200 uri = /baseboard
16872024-11-01T22:27:38.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52082
16882024-11-01T22:27:38.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52082 req_id = 1de32d9e-4b10-445e-8720-7795b99d2b0f response_code = 200 uri = /vpc-routes
16892024-11-01T22:27:38.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16902024-11-01T22:27:38.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52082 req_id = e8ca3659-568d-47db-bbda-55eb1b3319b8 response_code = 204 uri = /eip-gateways
16912024-11-01T22:27:38.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51973
16922024-11-01T22:27:38.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51973 req_id = b0f52f7c-0c25-4c8b-a1bf-a865f44bc97f response_code = 200 uri = /vpc-routes
16932024-11-01T22:27:38.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
16942024-11-01T22:27:38.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51973 req_id = 6191b036-5b22-4b0f-871a-3d4de5fe3db5 response_code = 204 uri = /eip-gateways
16952024-11-01T22:27:38.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51973 req_id = 33319048-c309-4068-8412-e864a6cce989 response_code = 204 uri = /vpc-routes
16962024-11-01T22:27:38.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34194
16972024-11-01T22:27:38.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34194 req_id = 790a0030-befa-420f-b1fa-5597b3e97136 response_code = 200 uri = /v2p
16982024-11-01T22:27:38.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52082 req_id = 61af722a-0842-4052-855b-cbe2d8062b84 response_code = 204 uri = /vpc-routes
16992024-11-01T22:27:38.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42514
17002024-11-01T22:27:38.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42514 req_id = e41e421c-2c92-4dc4-b6c8-d34ab547312d response_code = 200 uri = /v2p
17012024-11-01T22:27:39.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38083
17022024-11-01T22:27:39.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17032024-11-01T22:27:39.057ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17042024-11-01T22:27:39.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38083 req_id = 0ae27895-5f0a-4dd8-9830-e6ef56c91d2e response_code = 204 uri = /switch-ports
17052024-11-01T22:27:39.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43848
17062024-11-01T22:27:39.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38083 req_id = 24685ccc-215e-43ca-92ad-23c810f0064c response_code = 200 uri = /network-bootstore-config
17072024-11-01T22:27:39.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43848 req_id = 5da4abff-65c3-4fca-80f9-3a6927258373 response_code = 200 uri = /v2p
17082024-11-01T22:27:39.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41862
17092024-11-01T22:27:39.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41862 req_id = 13c254fc-170a-431e-80f1-50e9c1f823f6 response_code = 200 uri = /vpc-routes
17102024-11-01T22:27:39.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
17112024-11-01T22:27:39.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41862 req_id = 5a2ecc3e-5b8f-4c73-9dfb-e59473d5e178 response_code = 204 uri = /eip-gateways
17122024-11-01T22:27:39.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41862 req_id = 2194b659-e1a9-4447-82a5-bfa66c6ad518 response_code = 204 uri = /vpc-routes
17132024-11-01T22:27:39.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61557
17142024-11-01T22:27:39.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17152024-11-01T22:27:39.298ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17162024-11-01T22:27:39.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61557 req_id = a5a860f1-a5b9-4424-977c-40f4fd8526c0 response_code = 204 uri = /switch-ports
17172024-11-01T22:27:39.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61557 req_id = a9f4433e-baac-4a63-9f86-f5502156f1ff response_code = 200 uri = /network-bootstore-config
17182024-11-01T22:27:39.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63929
17192024-11-01T22:27:39.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17202024-11-01T22:27:39.514ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17212024-11-01T22:27:39.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96436 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63929 req_id = 58ca0e75-252a-45e2-95c2-1471880db214 response_code = 204 uri = /switch-ports
17222024-11-01T22:27:39.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63929 req_id = 127ac69b-41a4-447b-87e4-2531ac7f8a9b response_code = 200 uri = /network-bootstore-config
17232024-11-01T22:27:48.678ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59942
17242024-11-01T22:27:48.678ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59942 req_id = ef5ad5d5-ae63-4f5b-b107-c3e3d4d76b86 response_code = 200 uri = /baseboard
17252024-11-01T22:28:08.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58154
17262024-11-01T22:28:08.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58154 req_id = 73b59413-9d1c-4ec6-bd05-d734980768ad response_code = 200 uri = /vpc-routes
17272024-11-01T22:28:08.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59733
17282024-11-01T22:28:08.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59733 req_id = e58d7d2c-a45d-4357-98ad-af194d5bba45 response_code = 200 uri = /vpc-routes
17292024-11-01T22:28:08.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
17302024-11-01T22:28:08.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58154 req_id = 97c09c8d-51c4-40b0-8dd4-3ed47cce897a response_code = 204 uri = /eip-gateways
17312024-11-01T22:28:08.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62021
17322024-11-01T22:28:08.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62021 req_id = 5cfedacf-8cfd-43ea-a65d-8d21cc205049 response_code = 200 uri = /v2p
17332024-11-01T22:28:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58154 req_id = ec308e7d-10da-4d84-9025-d62ab7e37cb7 response_code = 204 uri = /vpc-routes
17342024-11-01T22:28:08.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61161
17352024-11-01T22:28:08.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61161 req_id = 69dab625-e8e5-4e0a-9f97-0ab44f2ce0da response_code = 200 uri = /vpc-routes
17362024-11-01T22:28:08.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
17372024-11-01T22:28:08.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59733 req_id = 5f1820b1-caa6-48d5-a96e-46a517b97a79 response_code = 204 uri = /eip-gateways
17382024-11-01T22:28:08.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41258
17392024-11-01T22:28:08.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41258 req_id = 00081dd3-d2ee-4bfb-ac63-9839e2766966 response_code = 200 uri = /v2p
17402024-11-01T22:28:08.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59733 req_id = fe0acf28-c51c-47d4-b57d-b0de7f82b3f4 response_code = 204 uri = /vpc-routes
17412024-11-01T22:28:08.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37085
17422024-11-01T22:28:08.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17432024-11-01T22:28:08.977ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17442024-11-01T22:28:09.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37085 req_id = b108cff6-d386-429f-a534-8cc083fcf504 response_code = 204 uri = /switch-ports
17452024-11-01T22:28:09.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45586
17462024-11-01T22:28:09.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35709
17472024-11-01T22:28:09.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17482024-11-01T22:28:09.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
17492024-11-01T22:28:09.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61161 req_id = 1b342925-46a9-42c5-8730-2989c76e3dd0 response_code = 204 uri = /eip-gateways
17502024-11-01T22:28:09.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3447 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37085 req_id = d1d70d20-177e-4fe0-855b-d2707cea46b8 response_code = 200 uri = /network-bootstore-config
17512024-11-01T22:28:09.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57671
17522024-11-01T22:28:09.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 683 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57671 req_id = b9bd1591-1759-462d-a856-919b3f57cb3c response_code = 200 uri = /v2p
17532024-11-01T22:28:09.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2569 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61161 req_id = 362562c2-ba0f-4c17-9c46-2607d65e7e09 response_code = 204 uri = /vpc-routes
17542024-11-01T22:28:09.078ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17552024-11-01T22:28:09.133ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17562024-11-01T22:28:09.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90765 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35709 req_id = 56e24a88-f7f7-40d6-8783-bc2af7c5bf29 response_code = 204 uri = /switch-ports
17572024-11-01T22:28:09.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35709 req_id = 3cbd28b9-0c42-4c56-8f41-2a69672768cf response_code = 200 uri = /network-bootstore-config
17582024-11-01T22:28:09.163ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17592024-11-01T22:28:09.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165250 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45586 req_id = e4d95075-c392-4514-a07a-3548f06e0cfb response_code = 204 uri = /switch-ports
17602024-11-01T22:28:09.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45586 req_id = 8c509188-a3c2-4322-9e9e-b23f01989b04 response_code = 200 uri = /network-bootstore-config
17612024-11-01T22:28:18.711ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60635
17622024-11-01T22:28:18.711ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60635 req_id = 73dc1c89-d60f-4b37-b2c6-80e55f4918a4 response_code = 200 uri = /baseboard
17632024-11-01T22:28:38.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47612
17642024-11-01T22:28:38.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47612 req_id = 14ce0db8-ddfd-4fb0-b54f-c34c86cf4ec6 response_code = 200 uri = /vpc-routes
17652024-11-01T22:28:38.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57358
17662024-11-01T22:28:38.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 631 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57358 req_id = 6c2ce282-605a-4059-87aa-d6cf060bbe38 response_code = 200 uri = /vpc-routes
17672024-11-01T22:28:38.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
17682024-11-01T22:28:38.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 631 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47612 req_id = 4c749ef6-fee5-4fad-8d78-facb1e8fd835 response_code = 204 uri = /eip-gateways
17692024-11-01T22:28:38.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47612 req_id = 66bdc827-c560-484e-b831-dbf21715dd52 response_code = 204 uri = /vpc-routes
17702024-11-01T22:28:38.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
17712024-11-01T22:28:38.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57358 req_id = 979ded4e-2df2-4d63-8c01-60efb55761bd response_code = 204 uri = /eip-gateways
17722024-11-01T22:28:38.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57358 req_id = a599dceb-9d9a-486a-89cd-1c88abee6b13 response_code = 204 uri = /vpc-routes
17732024-11-01T22:28:38.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59529
17742024-11-01T22:28:38.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59529 req_id = a0f179f9-fea7-4682-9054-171fdeacbdd1 response_code = 200 uri = /v2p
17752024-11-01T22:28:38.974ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
17762024-11-01T22:28:38.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64053
17772024-11-01T22:28:38.975ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17782024-11-01T22:28:39.015ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17792024-11-01T22:28:39.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64053 req_id = 0d477cf0-ef85-466e-ad5a-3055fe534a92 response_code = 204 uri = /switch-ports
17802024-11-01T22:28:39.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46536
17812024-11-01T22:28:39.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57938
17822024-11-01T22:28:39.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17832024-11-01T22:28:39.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64053 req_id = 3c6bc85f-2649-49a8-89b8-a30ac88a44ab response_code = 200 uri = /network-bootstore-config
17842024-11-01T22:28:39.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46536 req_id = 0a9b3144-e973-43b0-ab4c-3ee7e62ed9cf response_code = 200 uri = /v2p
17852024-11-01T22:28:39.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48661
17862024-11-01T22:28:39.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48661 req_id = 6a1327e9-91c2-4284-bd92-8aca8b8c81f8 response_code = 200 uri = /vpc-routes
17872024-11-01T22:28:39.105ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17882024-11-01T22:28:39.131ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
17892024-11-01T22:28:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48661 req_id = 543c1511-e322-4dc1-be90-7b8bda10698e response_code = 204 uri = /eip-gateways
17902024-11-01T22:28:39.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48661 req_id = 7fb661f4-9c2e-4c1e-a0b1-c6a39171b8d9 response_code = 204 uri = /vpc-routes
17912024-11-01T22:28:39.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57938 req_id = 08bc3cd5-645b-46a0-aee3-5ee46b3c5088 response_code = 204 uri = /switch-ports
17922024-11-01T22:28:39.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57938 req_id = e25b9b2e-78f4-4ce4-b379-f46ec52b8235 response_code = 200 uri = /network-bootstore-config
17932024-11-01T22:28:39.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57499
17942024-11-01T22:28:39.191ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17952024-11-01T22:28:39.229ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17962024-11-01T22:28:39.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57499 req_id = 604203b5-e8dd-4541-9460-49436534f62d response_code = 204 uri = /switch-ports
17972024-11-01T22:28:39.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52987
17982024-11-01T22:28:39.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57499 req_id = 4f11fc22-af19-4bac-8478-2f9456baaa7e response_code = 200 uri = /network-bootstore-config
17992024-11-01T22:28:39.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52987 req_id = 208d1bf5-eda6-4535-b36c-51d7faa6bacd response_code = 200 uri = /v2p
18002024-11-01T22:28:48.747ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43503
18012024-11-01T22:28:48.747ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43503 req_id = bd5fd745-a4d7-4291-a051-2ca382de60d3 response_code = 200 uri = /baseboard
18022024-11-01T22:29:08.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58866
18032024-11-01T22:29:08.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58866 req_id = 4763a943-0c39-45c8-bde7-bd068646dcb3 response_code = 200 uri = /vpc-routes
18042024-11-01T22:29:08.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18052024-11-01T22:29:08.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58866 req_id = 003e707c-a0cc-4169-adaa-caa595ef34eb response_code = 204 uri = /eip-gateways
18062024-11-01T22:29:08.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58866 req_id = cdc125ab-cd9f-4823-a8a6-447908adc141 response_code = 204 uri = /vpc-routes
18072024-11-01T22:29:08.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53525
18082024-11-01T22:29:08.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18092024-11-01T22:29:08.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18102024-11-01T22:29:08.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53525 req_id = 8e24d80b-176d-4c19-b34e-dc4cfca62c91 response_code = 204 uri = /switch-ports
18112024-11-01T22:29:08.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53525 req_id = 33c34b94-64a2-44ee-a014-e29e7b939f13 response_code = 200 uri = /network-bootstore-config
18122024-11-01T22:29:08.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47725
18132024-11-01T22:29:08.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47725 req_id = 6a2a4c97-7752-4ea5-9055-dddedcb33a96 response_code = 200 uri = /v2p
18142024-11-01T22:29:08.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54655
18152024-11-01T22:29:08.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54655 req_id = 464516ef-498d-43bb-b457-1b83603edf34 response_code = 200 uri = /vpc-routes
18162024-11-01T22:29:08.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18172024-11-01T22:29:08.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54655 req_id = a7c0ddbc-91d3-47a7-894b-362472306080 response_code = 204 uri = /eip-gateways
18182024-11-01T22:29:08.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50693
18192024-11-01T22:29:08.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50693 req_id = 85ffb9d4-603f-4976-b90c-db6a80432c25 response_code = 200 uri = /vpc-routes
18202024-11-01T22:29:08.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48405
18212024-11-01T22:29:08.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48405 req_id = 21f7e419-0150-4b83-b111-6bc4c0dd6d73 response_code = 200 uri = /v2p
18222024-11-01T22:29:08.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54655 req_id = 2fed02f0-253e-4931-8c57-548362b4fd3e response_code = 204 uri = /vpc-routes
18232024-11-01T22:29:08.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54459
18242024-11-01T22:29:08.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54459 req_id = 819aa750-2bde-4d50-941f-d2d2662a9a5e response_code = 200 uri = /v2p
18252024-11-01T22:29:09.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18262024-11-01T22:29:09.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50693 req_id = a7312b07-69b8-435e-a4b6-e315b1d99740 response_code = 204 uri = /eip-gateways
18272024-11-01T22:29:09.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55466
18282024-11-01T22:29:09.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18292024-11-01T22:29:09.041ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18302024-11-01T22:29:09.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91054 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55466 req_id = f671b717-2056-4e9c-8d3f-7709baf986e7 response_code = 204 uri = /switch-ports
18312024-11-01T22:29:09.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50693 req_id = d5ff4185-25e4-4a04-8a8a-7b4f0d2a3fd2 response_code = 204 uri = /vpc-routes
18322024-11-01T22:29:09.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55466 req_id = 68744080-9dd4-49ec-a477-d068baef7b54 response_code = 200 uri = /network-bootstore-config
18332024-11-01T22:29:09.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54290
18342024-11-01T22:29:09.098ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18352024-11-01T22:29:09.145ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18362024-11-01T22:29:09.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108699 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54290 req_id = bb729991-6aca-4f43-8a0f-4b311b86d3bb response_code = 204 uri = /switch-ports
18372024-11-01T22:29:09.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54290 req_id = 32ab1c3f-314c-4b5d-a967-4dbb2758eeea response_code = 200 uri = /network-bootstore-config
18382024-11-01T22:29:18.780ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55161
18392024-11-01T22:29:18.781ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55161 req_id = ace6e2b0-7a2d-4332-b054-e8f444878bb5 response_code = 200 uri = /baseboard
18402024-11-01T22:29:38.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60716
18412024-11-01T22:29:38.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60716 req_id = 54610432-23ba-47a1-b8d4-295d1429a5a3 response_code = 200 uri = /vpc-routes
18422024-11-01T22:29:38.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36029
18432024-11-01T22:29:38.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36029 req_id = b32c7b66-7061-4c56-ae2b-526c925b20dd response_code = 200 uri = /vpc-routes
18442024-11-01T22:29:38.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39426
18452024-11-01T22:29:38.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39426 req_id = e85502f7-9013-4502-a888-242c147c4c71 response_code = 200 uri = /v2p
18462024-11-01T22:29:38.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18472024-11-01T22:29:38.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36029 req_id = 896b1f39-b785-4de4-a55f-02ea9e61bee7 response_code = 204 uri = /eip-gateways
18482024-11-01T22:29:38.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36029 req_id = 11c81dc9-a902-4383-8df8-6e7d3782d4df response_code = 204 uri = /vpc-routes
18492024-11-01T22:29:38.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18502024-11-01T22:29:38.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60716 req_id = 36eb46fd-c6f3-4987-a7cd-15bed6bbf3b5 response_code = 204 uri = /eip-gateways
18512024-11-01T22:29:38.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60716 req_id = 230accbb-7429-4ba7-bba0-04b031461d0e response_code = 204 uri = /vpc-routes
18522024-11-01T22:29:38.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52122
18532024-11-01T22:29:38.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52122 req_id = 65f923fb-a9cb-4ca2-8463-240bcb6d0c96 response_code = 200 uri = /v2p
18542024-11-01T22:29:39.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41124
18552024-11-01T22:29:39.018ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18562024-11-01T22:29:39.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18572024-11-01T22:29:39.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41124 req_id = 12720ed7-6088-446e-9ae2-6b7d3816d0a5 response_code = 204 uri = /switch-ports
18582024-11-01T22:29:39.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51513
18592024-11-01T22:29:39.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42416
18602024-11-01T22:29:39.115ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18612024-11-01T22:29:39.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3477 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41124 req_id = d450b337-036f-4d89-9952-e9ac45b1a57a response_code = 200 uri = /network-bootstore-config
18622024-11-01T22:29:39.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3497 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51513 req_id = ccc82688-cfff-4504-8f37-27ac7393f89e response_code = 200 uri = /vpc-routes
18632024-11-01T22:29:39.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18642024-11-01T22:29:39.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45116
18652024-11-01T22:29:39.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45116 req_id = b09b1a41-2e61-496a-bfa0-12945568c429 response_code = 200 uri = /v2p
18662024-11-01T22:29:39.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42416 req_id = bb6c5aa3-2138-4215-84a4-091cdf582b4a response_code = 204 uri = /switch-ports
18672024-11-01T22:29:39.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42416 req_id = eceb9c77-0988-4e5e-912a-76f1b306d504 response_code = 200 uri = /network-bootstore-config
18682024-11-01T22:29:39.240ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18692024-11-01T22:29:39.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51513 req_id = 8d9e4540-e97c-48cf-927f-fe111d3c3a2f response_code = 204 uri = /eip-gateways
18702024-11-01T22:29:39.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51513 req_id = e79444c1-3a04-4aad-bf73-6be6f848864a response_code = 204 uri = /vpc-routes
18712024-11-01T22:29:39.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49851
18722024-11-01T22:29:39.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18732024-11-01T22:29:39.332ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18742024-11-01T22:29:39.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100073 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49851 req_id = 7b594969-a39b-4d72-ba5f-245d8f8d5fc2 response_code = 204 uri = /switch-ports
18752024-11-01T22:29:39.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49851 req_id = 21675a09-3344-4b0c-9f72-a831f610ba39 response_code = 200 uri = /network-bootstore-config
18762024-11-01T22:29:48.815ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41376
18772024-11-01T22:29:48.815ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41376 req_id = 1a1daac8-c5c5-4ecb-b9ce-16c7bf01603b response_code = 200 uri = /baseboard
18782024-11-01T22:30:08.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43951
18792024-11-01T22:30:08.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43951 req_id = ca53c3da-eae0-49dd-b196-907b0e690833 response_code = 200 uri = /vpc-routes
18802024-11-01T22:30:08.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18812024-11-01T22:30:08.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43951 req_id = dfa94b73-3be9-4b96-9dc1-884b65c27388 response_code = 204 uri = /eip-gateways
18822024-11-01T22:30:08.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43951 req_id = 225ee68a-346e-4a0d-b014-7e7042561642 response_code = 204 uri = /vpc-routes
18832024-11-01T22:30:08.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43053
18842024-11-01T22:30:08.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43053 req_id = a4eb2c00-13f0-4fde-80ee-c1956f577910 response_code = 200 uri = /vpc-routes
18852024-11-01T22:30:08.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36100
18862024-11-01T22:30:08.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36100 req_id = 3dedf7d4-681d-4028-ad56-ed981fbaf441 response_code = 200 uri = /v2p
18872024-11-01T22:30:08.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
18882024-11-01T22:30:08.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43053 req_id = 45a53ce1-6f11-42e9-a37e-f5cf20ba6398 response_code = 204 uri = /eip-gateways
18892024-11-01T22:30:08.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50445
18902024-11-01T22:30:08.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50445 req_id = 4c353c5e-5e01-47ac-8f80-3e7b014b2351 response_code = 200 uri = /v2p
18912024-11-01T22:30:08.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43053 req_id = 6888a40e-05f2-4964-a933-daafb37248e2 response_code = 204 uri = /vpc-routes
18922024-11-01T22:30:08.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42531
18932024-11-01T22:30:08.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42531 req_id = 42a7fcc3-dfd1-448c-b411-ebbe3e0284a5 response_code = 200 uri = /vpc-routes
18942024-11-01T22:30:08.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36673
18952024-11-01T22:30:08.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18962024-11-01T22:30:08.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18972024-11-01T22:30:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36673 req_id = dfd2ace3-59d8-4a56-a212-57ff6e90f16b response_code = 204 uri = /switch-ports
18982024-11-01T22:30:08.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35112
18992024-11-01T22:30:08.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
19002024-11-01T22:30:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42531 req_id = e891eef0-ed24-4969-a9b9-d403bf3a8b6a response_code = 204 uri = /eip-gateways
19012024-11-01T22:30:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36673 req_id = ee0fe739-6e92-4d68-a5b6-0d97d6b6d062 response_code = 200 uri = /network-bootstore-config
19022024-11-01T22:30:08.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19032024-11-01T22:30:08.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49889
19042024-11-01T22:30:08.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49889 req_id = ee2267af-c700-446e-8e7d-ac1ac50397cf response_code = 200 uri = /v2p
19052024-11-01T22:30:08.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42531 req_id = 089b9f49-ad59-4507-ac9f-c31d07c6c695 response_code = 204 uri = /vpc-routes
19062024-11-01T22:30:08.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19072024-11-01T22:30:09.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46619
19082024-11-01T22:30:09.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35112 req_id = 7fa6f9e2-60ee-40eb-b3ac-90eb27efbe2c response_code = 204 uri = /switch-ports
19092024-11-01T22:30:09.052ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19102024-11-01T22:30:09.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35112 req_id = 1b151830-e870-489e-9d74-f3f99db0c8e5 response_code = 200 uri = /network-bootstore-config
19112024-11-01T22:30:09.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19122024-11-01T22:30:09.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46619 req_id = 004b35a4-ae1c-4aa9-8c5a-a13f34511d77 response_code = 204 uri = /switch-ports
19132024-11-01T22:30:09.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46619 req_id = 761c6e3b-d59f-4ec2-963d-abd14b72a3d0 response_code = 200 uri = /network-bootstore-config
19142024-11-01T22:30:18.850ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56185
19152024-11-01T22:30:18.850ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56185 req_id = 024f1500-09c9-407d-87e6-13e4fd1f5961 response_code = 200 uri = /baseboard
19162024-11-01T22:30:38.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52145
19172024-11-01T22:30:38.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52145 req_id = a3c5e971-7e43-4eac-9ccc-8f4d83ec1f4e response_code = 200 uri = /vpc-routes
19182024-11-01T22:30:38.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
19192024-11-01T22:30:38.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52145 req_id = 0f8f683e-e4ef-41b8-a844-1badb7a614c0 response_code = 204 uri = /eip-gateways
19202024-11-01T22:30:38.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52145 req_id = 66cda3f7-e234-479e-a77a-43e1fce9b016 response_code = 204 uri = /vpc-routes
19212024-11-01T22:30:38.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43968
19222024-11-01T22:30:38.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43968 req_id = b3cfc4fb-432d-4ef2-863a-a93194df8330 response_code = 200 uri = /vpc-routes
19232024-11-01T22:30:38.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
19242024-11-01T22:30:38.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43968 req_id = 9e222337-52cd-478a-82e2-fc1c442f054d response_code = 204 uri = /eip-gateways
19252024-11-01T22:30:38.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43968 req_id = d02bd7e0-442a-4274-baca-020e80e80c7d response_code = 204 uri = /vpc-routes
19262024-11-01T22:30:38.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33540
19272024-11-01T22:30:38.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33540 req_id = c9e13bba-d083-4635-a6b9-b5065274a8b2 response_code = 200 uri = /v2p
19282024-11-01T22:30:39.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44408
19292024-11-01T22:30:39.015ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19302024-11-01T22:30:39.062ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19312024-11-01T22:30:39.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44408 req_id = e20ee950-91bf-4446-9886-087dd0783fc8 response_code = 204 uri = /switch-ports
19322024-11-01T22:30:39.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50150
19332024-11-01T22:30:39.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50547
19342024-11-01T22:30:39.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38007
19352024-11-01T22:30:39.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43994
19362024-11-01T22:30:39.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44408 req_id = 3ebe5dae-583f-475e-ba14-a33d3d82224e response_code = 200 uri = /network-bootstore-config
19372024-11-01T22:30:39.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19382024-11-01T22:30:39.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38007 req_id = cb1a98ad-31ae-40b3-bd37-0f1c996236c1 response_code = 200 uri = /vpc-routes
19392024-11-01T22:30:39.134ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19402024-11-01T22:30:39.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19412024-11-01T22:30:39.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19422024-11-01T22:30:39.139ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19432024-11-01T22:30:39.139ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19442024-11-01T22:30:39.139ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19452024-11-01T22:30:39.139ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19462024-11-01T22:30:39.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6077 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43994 req_id = b8742b66-1dca-4f58-9b00-6df82f8892d8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19472024-11-01T22:30:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5951 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50150 req_id = 29b7ef70-7c12-43a1-9d42-79406a0cefec response_code = 200 uri = /v2p
19482024-11-01T22:30:39.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35213
19492024-11-01T22:30:39.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35213 req_id = 9d2248c0-df63-4afd-88dc-26dd9b572d8a response_code = 200 uri = /v2p
19502024-11-01T22:30:39.176ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19512024-11-01T22:30:39.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42500
19522024-11-01T22:30:39.218ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
19532024-11-01T22:30:39.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38007 req_id = 9ef5ed31-1e62-4b6b-a0b4-eb120d828c92 response_code = 204 uri = /eip-gateways
19542024-11-01T22:30:39.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60501
19552024-11-01T22:30:39.220ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19562024-11-01T22:30:39.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19572024-11-01T22:30:39.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19582024-11-01T22:30:39.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19592024-11-01T22:30:39.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19602024-11-01T22:30:39.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19612024-11-01T22:30:39.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19622024-11-01T22:30:39.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 427 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60501 req_id = 23087210-71a5-42e3-b37c-dc9cad3bb5e6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19632024-11-01T22:30:39.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 855 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38007 req_id = 6d4e7a8e-21f0-4f1a-b004-fb5388781c9a response_code = 204 uri = /vpc-routes
19642024-11-01T22:30:39.237ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19652024-11-01T22:30:39.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50547 req_id = a15f315c-63c9-42b2-94a3-a2954fe0c720 response_code = 204 uri = /switch-ports
19662024-11-01T22:30:39.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50547 req_id = 593e1e4b-829e-443c-bf45-c21e7e58edf4 response_code = 200 uri = /network-bootstore-config
19672024-11-01T22:30:39.273ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19682024-11-01T22:30:39.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42500 req_id = 92cd7a8b-aff6-4200-88c0-d271d5304d9b response_code = 204 uri = /switch-ports
19692024-11-01T22:30:39.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42500 req_id = 93ff1975-3d4b-429b-bdb9-02c11f669ea5 response_code = 200 uri = /network-bootstore-config
19702024-11-01T22:30:39.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60521
19712024-11-01T22:30:39.421ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19722024-11-01T22:30:39.421ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19732024-11-01T22:30:39.421ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19742024-11-01T22:30:39.421ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19752024-11-01T22:30:39.421ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19762024-11-01T22:30:39.421ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19772024-11-01T22:30:39.421ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19782024-11-01T22:30:39.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60521 req_id = 54548d26-9e21-4315-affa-19169d5bdda0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19792024-11-01T22:30:48.883ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34591
19802024-11-01T22:30:48.883ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34591 req_id = 1fc604eb-5715-4583-ad56-e306b650472f response_code = 200 uri = /baseboard
19812024-11-01T22:31:08.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40272
19822024-11-01T22:31:08.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40272 req_id = 8c48212c-fcd5-4a78-889f-96ae786e04f0 response_code = 200 uri = /vpc-routes
19832024-11-01T22:31:08.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
19842024-11-01T22:31:08.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40272 req_id = bba30ea8-0b37-47a2-a192-e1ce50368a0a response_code = 204 uri = /eip-gateways
19852024-11-01T22:31:08.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40272 req_id = 958436c4-e750-4378-8027-2363e9759b00 response_code = 204 uri = /vpc-routes
19862024-11-01T22:31:08.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55940
19872024-11-01T22:31:08.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55940 req_id = 2383728a-4b8d-47f5-962c-47c8bb60283a response_code = 200 uri = /vpc-routes
19882024-11-01T22:31:08.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37677
19892024-11-01T22:31:08.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37677 req_id = c97691cd-0356-4699-ac1a-d9739d809eeb response_code = 200 uri = /v2p
19902024-11-01T22:31:08.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
19912024-11-01T22:31:08.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55940 req_id = 4e7575f2-a7bd-4e02-9a68-5100c15230b3 response_code = 204 uri = /eip-gateways
19922024-11-01T22:31:08.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55940 req_id = 7ab48b08-1223-4934-b140-02eb1d35aed7 response_code = 204 uri = /vpc-routes
19932024-11-01T22:31:08.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42648
19942024-11-01T22:31:08.810ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19952024-11-01T22:31:08.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19962024-11-01T22:31:08.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106933 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42648 req_id = bba6bed1-42a3-4abd-810e-7e11c54c3133 response_code = 204 uri = /switch-ports
19972024-11-01T22:31:08.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51501
19982024-11-01T22:31:08.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38816
19992024-11-01T22:31:08.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42648 req_id = 74d5913a-cf9b-4585-ba20-6e6220297862 response_code = 200 uri = /network-bootstore-config
20002024-11-01T22:31:08.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20012024-11-01T22:31:08.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38816 req_id = f95078ab-06d7-41cb-ac9f-c3755c4c5be6 response_code = 200 uri = /v2p
20022024-11-01T22:31:08.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20032024-11-01T22:31:08.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47529
20042024-11-01T22:31:08.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47529 req_id = 3ade887d-570f-4ae3-9caf-e54bd2bd24d7 response_code = 200 uri = /vpc-routes
20052024-11-01T22:31:08.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20062024-11-01T22:31:08.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47529 req_id = e87dc98a-c89e-4ade-8bed-5680738554dd response_code = 204 uri = /eip-gateways
20072024-11-01T22:31:09.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 713 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47529 req_id = b7c99dc4-ba31-4b71-b19e-d69543ccd005 response_code = 204 uri = /vpc-routes
20082024-11-01T22:31:09.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51501 req_id = 3f36eff8-d07d-454b-92a1-2ebdd247b260 response_code = 204 uri = /switch-ports
20092024-11-01T22:31:09.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51501 req_id = ebf8cd86-9187-4549-993e-06c636266c5a response_code = 200 uri = /network-bootstore-config
20102024-11-01T22:31:09.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33282
20112024-11-01T22:31:09.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33282 req_id = 1b7e4680-0ff2-4295-966e-485cb9c0841c response_code = 200 uri = /v2p
20122024-11-01T22:31:09.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64538
20132024-11-01T22:31:09.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20142024-11-01T22:31:09.111ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20152024-11-01T22:31:09.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64538 req_id = c38e18f9-38f9-4958-a19f-cbb64efaf22b response_code = 204 uri = /switch-ports
20162024-11-01T22:31:09.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64538 req_id = 0e6c60ab-52a7-4954-9375-adeb82250e60 response_code = 200 uri = /network-bootstore-config
20172024-11-01T22:31:18.918ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39291
20182024-11-01T22:31:18.918ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39291 req_id = 4e909881-c39c-44c1-a66a-a11e652da819 response_code = 200 uri = /baseboard
20192024-11-01T22:31:38.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44123
20202024-11-01T22:31:38.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44123 req_id = 20daa1ab-255c-4b03-8cb5-c2905defeead response_code = 200 uri = /vpc-routes
20212024-11-01T22:31:38.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20222024-11-01T22:31:38.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44123 req_id = 3a0e675c-0b5e-45ea-a510-e39ae68c2322 response_code = 204 uri = /eip-gateways
20232024-11-01T22:31:38.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44123 req_id = c7909d08-b9fa-4449-bd61-1e027b2a9911 response_code = 204 uri = /vpc-routes
20242024-11-01T22:31:38.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60974
20252024-11-01T22:31:38.977ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20262024-11-01T22:31:39.025ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20272024-11-01T22:31:39.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60974 req_id = 9ca51d02-7542-40ff-9117-869c8fcc73fd response_code = 204 uri = /switch-ports
20282024-11-01T22:31:39.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56700
20292024-11-01T22:31:39.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51745
20302024-11-01T22:31:39.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35421
20312024-11-01T22:31:39.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60974 req_id = 5c5346d8-f5bf-4371-bd10-d307fb1bd33c response_code = 200 uri = /network-bootstore-config
20322024-11-01T22:31:39.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56700 req_id = 29dcb4ad-a15b-4032-b856-f9d680725e52 response_code = 200 uri = /vpc-routes
20332024-11-01T22:31:39.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35421 req_id = 1ecfe7d3-75e8-44a3-b7ac-2a7a81e3c06a response_code = 200 uri = /v2p
20342024-11-01T22:31:39.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51745 req_id = b30744ce-5933-4b6d-a602-c42ba0945639 response_code = 200 uri = /v2p
20352024-11-01T22:31:39.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55397
20362024-11-01T22:31:39.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55397 req_id = 7baaa853-10f7-4e6a-8883-00ebe5cf5520 response_code = 200 uri = /vpc-routes
20372024-11-01T22:31:39.125ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20382024-11-01T22:31:39.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55397 req_id = 8ee5614a-1771-4f3c-9e99-d3bb5f094fce response_code = 204 uri = /eip-gateways
20392024-11-01T22:31:39.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55397 req_id = d97bcacc-67c6-41c8-bfed-25186990199b response_code = 204 uri = /vpc-routes
20402024-11-01T22:31:39.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20412024-11-01T22:31:39.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56700 req_id = 90361f9f-18f3-44f0-bffd-5d1a2b55fc93 response_code = 204 uri = /eip-gateways
20422024-11-01T22:31:39.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34100
20432024-11-01T22:31:39.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34100 req_id = afc7a118-8ad0-4e43-a79b-09848d03d57a response_code = 200 uri = /v2p
20442024-11-01T22:31:39.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56700 req_id = a9a222fb-b894-4769-9917-31f65ee0aa79 response_code = 204 uri = /vpc-routes
20452024-11-01T22:31:39.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48144
20462024-11-01T22:31:39.195ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20472024-11-01T22:31:39.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20482024-11-01T22:31:39.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48144 req_id = b949c0ad-b010-4fa9-8311-3f3cb3124e91 response_code = 204 uri = /switch-ports
20492024-11-01T22:31:39.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36977
20502024-11-01T22:31:39.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48144 req_id = 9c7644d1-0549-46a4-a595-097afff52c57 response_code = 200 uri = /network-bootstore-config
20512024-11-01T22:31:39.296ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20522024-11-01T22:31:39.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20532024-11-01T22:31:39.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36977 req_id = 9456d409-8aa3-4d37-8487-183a1af49eba response_code = 204 uri = /switch-ports
20542024-11-01T22:31:39.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36977 req_id = 75eeddb8-9e9a-4ccd-9723-da12c46cdc7b response_code = 200 uri = /network-bootstore-config
20552024-11-01T22:31:48.951ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58956
20562024-11-01T22:31:48.951ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58956 req_id = 80db4a2a-6888-4f00-a118-d6f3d24b9423 response_code = 200 uri = /baseboard
20572024-11-01T22:32:08.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44468
20582024-11-01T22:32:08.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44468 req_id = 375592ed-1fc0-434e-a7a0-92987ad2faa7 response_code = 200 uri = /vpc-routes
20592024-11-01T22:32:08.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37531
20602024-11-01T22:32:08.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37531 req_id = bf734e05-9512-4763-8832-cd689f8a9378 response_code = 200 uri = /vpc-routes
20612024-11-01T22:32:08.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20622024-11-01T22:32:08.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37531 req_id = ac0cc63b-c72c-4510-aa50-7229ef51a1c8 response_code = 204 uri = /eip-gateways
20632024-11-01T22:32:08.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20642024-11-01T22:32:08.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44468 req_id = ebf6f72f-ee4b-463a-b249-869def1a475b response_code = 204 uri = /eip-gateways
20652024-11-01T22:32:08.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37531 req_id = 548cae47-f7ec-4df6-983f-965fa3d7476c response_code = 204 uri = /vpc-routes
20662024-11-01T22:32:08.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44468 req_id = 5fc50f3f-202e-4dc8-817e-0783e9b6019a response_code = 204 uri = /vpc-routes
20672024-11-01T22:32:08.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36283
20682024-11-01T22:32:08.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36283 req_id = 71a303fb-95f7-42a7-b3ce-55607409d3c0 response_code = 200 uri = /v2p
20692024-11-01T22:32:08.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63960
20702024-11-01T22:32:08.742ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20712024-11-01T22:32:08.789ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20722024-11-01T22:32:08.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126022 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63960 req_id = 8201f9f3-f0cb-4fb4-8f1f-37ffa7dbcc9f response_code = 204 uri = /switch-ports
20732024-11-01T22:32:08.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63960 req_id = 99a59cf2-234b-40fb-91d5-5b505e0d18f1 response_code = 200 uri = /network-bootstore-config
20742024-11-01T22:32:08.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40049
20752024-11-01T22:32:08.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40049 req_id = a392d023-2016-48b5-a2a9-a617d849b229 response_code = 200 uri = /v2p
20762024-11-01T22:32:08.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57827
20772024-11-01T22:32:08.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20782024-11-01T22:32:08.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20792024-11-01T22:32:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57827 req_id = d19f7049-c980-4372-9813-bf46cf9faaad response_code = 204 uri = /switch-ports
20802024-11-01T22:32:09.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41531
20812024-11-01T22:32:09.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37464
20822024-11-01T22:32:09.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52911
20832024-11-01T22:32:09.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20842024-11-01T22:32:09.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3979 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41531 req_id = 2a6b0788-3ef7-469d-afb5-90c60531974a response_code = 200 uri = /vpc-routes
20852024-11-01T22:32:09.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37464 req_id = 2c00d19c-d52c-4ff8-aaf4-5d688eca5c64 response_code = 200 uri = /v2p
20862024-11-01T22:32:09.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57827 req_id = 850c4b55-942a-452f-8c3d-518a71137a3a response_code = 200 uri = /network-bootstore-config
20872024-11-01T22:32:09.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20882024-11-01T22:32:09.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41531 req_id = b5a70ab6-0ade-41db-a1ad-edff3637da45 response_code = 204 uri = /eip-gateways
20892024-11-01T22:32:09.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 806 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41531 req_id = 8d07e7bb-37fe-40e6-a495-e5da9d7a3487 response_code = 204 uri = /vpc-routes
20902024-11-01T22:32:09.100ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20912024-11-01T22:32:09.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52911 req_id = 1d783007-d1b1-41b5-a9f4-df2088e224de response_code = 204 uri = /switch-ports
20922024-11-01T22:32:09.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52911 req_id = 2eb3f067-6255-4414-be14-ef0eed66617b response_code = 200 uri = /network-bootstore-config
20932024-11-01T22:32:18.983ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48853
20942024-11-01T22:32:18.983ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48853 req_id = 2c188214-d782-455a-85c0-ed7ef8a43249 response_code = 200 uri = /baseboard
20952024-11-01T22:32:38.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44142
20962024-11-01T22:32:38.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44142 req_id = 9b8f50db-0e07-4914-91af-9144d07a5b84 response_code = 200 uri = /vpc-routes
20972024-11-01T22:32:38.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
20982024-11-01T22:32:38.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44142 req_id = df86f079-7336-4f80-aa50-767818d9de11 response_code = 204 uri = /eip-gateways
20992024-11-01T22:32:38.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44142 req_id = ddc15c8c-5890-4bd0-ae41-6feee61562cc response_code = 204 uri = /vpc-routes
21002024-11-01T22:32:38.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65295
21012024-11-01T22:32:38.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65295 req_id = 8c5f409e-19ed-4906-9f71-366215b4cae6 response_code = 200 uri = /vpc-routes
21022024-11-01T22:32:38.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
21032024-11-01T22:32:38.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65295 req_id = a37c14af-18b5-48a6-bca9-fda4e8eb6599 response_code = 204 uri = /eip-gateways
21042024-11-01T22:32:38.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55612
21052024-11-01T22:32:38.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55612 req_id = ac9db885-2d15-4a9e-bf9a-0366bc6479c8 response_code = 200 uri = /v2p
21062024-11-01T22:32:38.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65295 req_id = df85ace0-a89f-4838-aa60-7a4e08d68287 response_code = 204 uri = /vpc-routes
21072024-11-01T22:32:38.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36430
21082024-11-01T22:32:38.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36430 req_id = 783846a4-63e8-4655-848a-e3a853811a1c response_code = 200 uri = /v2p
21092024-11-01T22:32:39.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53108
21102024-11-01T22:32:39.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21112024-11-01T22:32:39.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21122024-11-01T22:32:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53108 req_id = 07ebf0c8-d46f-462b-bb9c-40e5d5f345a3 response_code = 204 uri = /switch-ports
21132024-11-01T22:32:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50404
21142024-11-01T22:32:39.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21152024-11-01T22:32:39.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21162024-11-01T22:32:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100185 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50404 req_id = 8bd2134d-7d86-4d5a-b564-cf0ed79e80fe response_code = 204 uri = /switch-ports
21172024-11-01T22:32:39.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46022
21182024-11-01T22:32:39.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53370
21192024-11-01T22:32:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53108 req_id = 1e05f80f-daeb-47b8-826b-09f00cd2d9d9 response_code = 200 uri = /network-bootstore-config
21202024-11-01T22:32:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50404 req_id = c45091ee-f1b3-4514-ad78-2acadc9c8d00 response_code = 200 uri = /network-bootstore-config
21212024-11-01T22:32:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46022 req_id = 5b51160d-4443-469e-9c1c-fee2a29ecdf3 response_code = 200 uri = /vpc-routes
21222024-11-01T22:32:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53370 req_id = 1ce68375-9000-45ba-8392-07a6d9ced34a response_code = 200 uri = /v2p
21232024-11-01T22:32:39.225ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
21242024-11-01T22:32:39.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46022 req_id = 0a03389a-c9b1-4a31-b4b1-11d78a190376 response_code = 204 uri = /eip-gateways
21252024-11-01T22:32:39.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46022 req_id = 15785ae3-b2a1-4351-a434-bc3a6e85246f response_code = 204 uri = /vpc-routes
21262024-11-01T22:32:39.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47235
21272024-11-01T22:32:39.241ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21282024-11-01T22:32:39.283ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21292024-11-01T22:32:39.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105745 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47235 req_id = b25eb916-ea39-4599-bb21-9a6d53e1333c response_code = 204 uri = /switch-ports
21302024-11-01T22:32:39.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47235 req_id = e41c56d9-844d-4395-9c7d-04e9b6a6d34c response_code = 200 uri = /network-bootstore-config
21312024-11-01T22:32:49.017ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51333
21322024-11-01T22:32:49.017ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51333 req_id = bd6179bb-9634-4def-9620-4f403f29d538 response_code = 200 uri = /baseboard
21332024-11-01T22:33:08.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54339
21342024-11-01T22:33:08.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54339 req_id = 4f03ca1a-dab6-4397-add3-07101c142067 response_code = 200 uri = /vpc-routes
21352024-11-01T22:33:08.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
21362024-11-01T22:33:08.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54339 req_id = f0c44e0c-e112-4720-a2f9-d3e58f04c8fb response_code = 204 uri = /eip-gateways
21372024-11-01T22:33:08.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37556
21382024-11-01T22:33:08.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37556 req_id = dcb3959c-bb16-4116-82a0-a6eba08f43d0 response_code = 200 uri = /vpc-routes
21392024-11-01T22:33:08.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54339 req_id = 67853c28-e954-436a-93d8-e10a7df66c1c response_code = 204 uri = /vpc-routes
21402024-11-01T22:33:08.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
21412024-11-01T22:33:08.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37556 req_id = f36bf70f-741f-4522-a548-17d6257aa93b response_code = 204 uri = /eip-gateways
21422024-11-01T22:33:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37556 req_id = 2ce9fbe6-b9ab-45dc-b12e-d11b7ae07483 response_code = 204 uri = /vpc-routes
21432024-11-01T22:33:08.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64452
21442024-11-01T22:33:08.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64452 req_id = f062e7d5-c201-4d92-8aae-13fe6d61e5ce response_code = 200 uri = /v2p
21452024-11-01T22:33:08.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55975
21462024-11-01T22:33:08.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55975 req_id = acf02e22-b35d-499b-a417-041f9f260b12 response_code = 200 uri = /v2p
21472024-11-01T22:33:08.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52091
21482024-11-01T22:33:08.824ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21492024-11-01T22:33:08.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21502024-11-01T22:33:08.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52091 req_id = 79f4fc81-770e-4769-ad13-756d2ab07747 response_code = 204 uri = /switch-ports
21512024-11-01T22:33:08.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53642
21522024-11-01T22:33:08.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52518
21532024-11-01T22:33:08.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52518 req_id = 669a4a38-ddcc-4848-824e-50b38e43c4e1 response_code = 200 uri = /vpc-routes
21542024-11-01T22:33:08.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52091 req_id = abbd0fb1-6d4f-41a2-b611-598bf36046f9 response_code = 200 uri = /network-bootstore-config
21552024-11-01T22:33:08.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21562024-11-01T22:33:08.970ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21572024-11-01T22:33:08.978ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
21582024-11-01T22:33:08.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52518 req_id = eac0e6b5-d70d-4c1b-a909-f7f237e58556 response_code = 204 uri = /eip-gateways
21592024-11-01T22:33:08.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 822 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52518 req_id = fba44373-77d6-475e-ab9b-b0bf65983fd9 response_code = 204 uri = /vpc-routes
21602024-11-01T22:33:09.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53994
21612024-11-01T22:33:09.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21622024-11-01T22:33:09.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53642 req_id = e2c0c7fd-9b3c-458c-9ee5-9d8e7f5c08fd response_code = 204 uri = /switch-ports
21632024-11-01T22:33:09.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53642 req_id = fc60d978-9cf0-4cdb-9cd2-66cf490c2c29 response_code = 200 uri = /network-bootstore-config
21642024-11-01T22:33:09.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65160
21652024-11-01T22:33:09.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65160 req_id = c1ab1551-8bc1-4eb6-839b-89e846e23685 response_code = 200 uri = /v2p
21662024-11-01T22:33:09.068ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21672024-11-01T22:33:09.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53994 req_id = 560aadce-6681-477f-83f2-55d13813c868 response_code = 204 uri = /switch-ports
21682024-11-01T22:33:09.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53994 req_id = 875dc83e-e19c-4605-ae22-7b91e3afa132 response_code = 200 uri = /network-bootstore-config
21692024-11-01T22:33:19.051ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43016
21702024-11-01T22:33:19.051ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43016 req_id = a6c30115-d28d-4f65-85e0-0511ada163b3 response_code = 200 uri = /baseboard
21712024-11-01T22:33:24.646ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
21722024-11-01T22:33:24.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
21732024-11-01T22:33:24.682ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1924, tv_nsec: 710714458 } time_to_next_cleanup = 599.99999791s
21742024-11-01T22:33:31.830ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21752024-11-01T22:33:31.847ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21762024-11-01T22:33:31.857ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21772024-11-01T22:33:31.860ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21782024-11-01T22:33:31.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21792024-11-01T22:33:31.887ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21802024-11-01T22:33:31.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21812024-11-01T22:33:31.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21822024-11-01T22:33:31.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
21832024-11-01T22:33:38.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54927
21842024-11-01T22:33:38.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54927 req_id = f348f853-2701-42a8-8f0c-8c8a0c2e12e2 response_code = 200 uri = /vpc-routes
21852024-11-01T22:33:38.730ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
21862024-11-01T22:33:38.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54927 req_id = f45b7a82-65e8-4f80-b4dd-3fffe0a956c3 response_code = 204 uri = /eip-gateways
21872024-11-01T22:33:38.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54927 req_id = 79b1acd9-5ff0-4d15-9a1d-d81f5d04ad90 response_code = 204 uri = /vpc-routes
21882024-11-01T22:33:38.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50868
21892024-11-01T22:33:38.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50868 req_id = 18f0a4f9-344f-4c8e-96f1-b6ded5732089 response_code = 200 uri = /v2p
21902024-11-01T22:33:38.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55836
21912024-11-01T22:33:38.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55836 req_id = e4c982a1-ec3d-4df0-b6da-a3cd10014b25 response_code = 200 uri = /vpc-routes
21922024-11-01T22:33:38.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35957
21932024-11-01T22:33:38.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35957 req_id = 46d439ea-6d24-48f7-9f73-56f27f92527f response_code = 200 uri = /v2p
21942024-11-01T22:33:38.972ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
21952024-11-01T22:33:38.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55836 req_id = 22d65bea-5ffb-4f4b-b239-34b6ec38ba55 response_code = 204 uri = /eip-gateways
21962024-11-01T22:33:38.978ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21972024-11-01T22:33:38.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55836 req_id = c8c1e5e5-13f4-4d5c-91e5-8e9a571af74a response_code = 204 uri = /vpc-routes
21982024-11-01T22:33:38.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49734
21992024-11-01T22:33:38.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22002024-11-01T22:33:39.037ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22012024-11-01T22:33:39.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49734 req_id = 9bebce5d-1d57-4265-aebe-b85457f7854c response_code = 204 uri = /switch-ports
22022024-11-01T22:33:39.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59313
22032024-11-01T22:33:39.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53276
22042024-11-01T22:33:39.106ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22052024-11-01T22:33:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59313 req_id = 58b6f362-276e-471f-b3a3-dc1aa7fb52d0 response_code = 200 uri = /vpc-routes
22062024-11-01T22:33:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49734 req_id = fa30a34a-2bf9-4bc4-a059-21100fc2bc29 response_code = 200 uri = /network-bootstore-config
22072024-11-01T22:33:39.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
22082024-11-01T22:33:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59313 req_id = 3076056f-c2d1-4612-8073-72853a414f81 response_code = 204 uri = /eip-gateways
22092024-11-01T22:33:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59313 req_id = 67cb3908-67bb-413d-bbfa-e3cb6ccd1283 response_code = 204 uri = /vpc-routes
22102024-11-01T22:33:39.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22112024-11-01T22:33:39.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42874
22122024-11-01T22:33:39.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42874 req_id = 3e7c9229-edc8-4e7a-abbc-b5cf0eb6052f response_code = 200 uri = /v2p
22132024-11-01T22:33:39.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98633 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53276 req_id = 74cd6cca-a50b-4f23-a442-a3a409c0618b response_code = 204 uri = /switch-ports
22142024-11-01T22:33:39.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53276 req_id = dd45586f-225a-419e-a118-7b7f61772ace response_code = 200 uri = /network-bootstore-config
22152024-11-01T22:33:39.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35901
22162024-11-01T22:33:39.232ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22172024-11-01T22:33:39.268ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22182024-11-01T22:33:39.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35901 req_id = e8fc1b82-9040-4cea-9fc8-947950046dd5 response_code = 204 uri = /switch-ports
22192024-11-01T22:33:39.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35901 req_id = e57f6f8b-4812-4d2e-805a-545d2874eeac response_code = 200 uri = /network-bootstore-config
22202024-11-01T22:33:41.831ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22212024-11-01T22:33:41.831ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22222024-11-01T22:33:41.832ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22232024-11-01T22:33:41.833ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22242024-11-01T22:33:41.833ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22252024-11-01T22:33:41.834ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22262024-11-01T22:33:41.835ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22272024-11-01T22:33:41.835ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22282024-11-01T22:33:41.848ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22292024-11-01T22:33:41.859ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22302024-11-01T22:33:41.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22312024-11-01T22:33:41.863ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22322024-11-01T22:33:41.864ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22332024-11-01T22:33:41.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22342024-11-01T22:33:41.889ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22352024-11-01T22:33:41.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22362024-11-01T22:33:41.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22372024-11-01T22:33:41.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22382024-11-01T22:33:49.084ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48277
22392024-11-01T22:33:49.085ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48277 req_id = 0b0ff0e6-a89b-4286-b396-36a7b5a80b71 response_code = 200 uri = /baseboard
22402024-11-01T22:33:51.835ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22412024-11-01T22:33:51.836ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22422024-11-01T22:33:51.836ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22432024-11-01T22:33:51.837ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22442024-11-01T22:33:51.838ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22452024-11-01T22:33:51.838ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22462024-11-01T22:33:51.839ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22472024-11-01T22:33:51.840ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22482024-11-01T22:33:51.850ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22492024-11-01T22:33:51.860ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22502024-11-01T22:33:51.864ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22512024-11-01T22:33:51.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22522024-11-01T22:33:51.866ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22532024-11-01T22:33:51.875ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22542024-11-01T22:33:51.891ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22552024-11-01T22:33:51.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22562024-11-01T22:33:51.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22572024-11-01T22:33:51.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22582024-11-01T22:34:01.841ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22592024-11-01T22:34:01.842ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22602024-11-01T22:34:01.843ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22612024-11-01T22:34:01.843ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22622024-11-01T22:34:01.844ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22632024-11-01T22:34:01.845ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22642024-11-01T22:34:01.845ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22652024-11-01T22:34:01.846ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22662024-11-01T22:34:01.851ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22672024-11-01T22:34:01.863ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22682024-11-01T22:34:01.866ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22692024-11-01T22:34:01.866ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22702024-11-01T22:34:01.867ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22712024-11-01T22:34:01.877ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22722024-11-01T22:34:01.893ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22732024-11-01T22:34:01.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22742024-11-01T22:34:01.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22752024-11-01T22:34:01.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
22762024-11-01T22:34:08.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53158
22772024-11-01T22:34:08.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53158 req_id = 6d7b0269-92c1-4cee-b6e4-f4ee4ea26bd2 response_code = 200 uri = /vpc-routes
22782024-11-01T22:34:08.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
22792024-11-01T22:34:08.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53158 req_id = 4f3836f4-6e7f-4ba0-973f-ff2184c98d50 response_code = 204 uri = /eip-gateways
22802024-11-01T22:34:08.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53158 req_id = bb760610-5bb1-4b70-80e3-ca809238d7a4 response_code = 204 uri = /vpc-routes
22812024-11-01T22:34:08.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47348
22822024-11-01T22:34:08.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22832024-11-01T22:34:08.780ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22842024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47348 req_id = a347843b-3616-4079-b0b4-25e53c39ee59 response_code = 204 uri = /switch-ports
22852024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35195
22862024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65487
22872024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57004
22882024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45502
22892024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47348 req_id = 86a36a1c-99b4-4f44-8114-683b03ef7833 response_code = 200 uri = /network-bootstore-config
22902024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65487 req_id = 6299ab92-828a-4faa-8382-01afa08a9ae3 response_code = 200 uri = /vpc-routes
22912024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57004 req_id = 5e82f072-934d-4f2b-aa87-2ae044270345 response_code = 200 uri = /vpc-routes
22922024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45502 req_id = a64b039e-d6ad-4fa8-b8b8-239fb92f10d0 response_code = 200 uri = /v2p
22932024-11-01T22:34:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35195 req_id = e5e491f9-8ada-4b3a-a4a6-47e6918334f6 response_code = 200 uri = /v2p
22942024-11-01T22:34:08.865ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
22952024-11-01T22:34:08.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57004 req_id = ad0ceaef-5d4f-4d33-8370-d584b8b7858e response_code = 204 uri = /eip-gateways
22962024-11-01T22:34:08.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57004 req_id = f10e3f75-6cf2-4a88-a992-2c987f3b28cb response_code = 204 uri = /vpc-routes
22972024-11-01T22:34:08.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65161
22982024-11-01T22:34:08.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22992024-11-01T22:34:08.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23002024-11-01T22:34:08.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103096 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65161 req_id = adeae283-c10d-41e1-9b49-0a458b36ca48 response_code = 204 uri = /switch-ports
23012024-11-01T22:34:08.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65161 req_id = aba43576-4567-445f-8f86-e84a3f121644 response_code = 200 uri = /network-bootstore-config
23022024-11-01T22:34:09.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55863
23032024-11-01T22:34:09.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55863 req_id = 425bd6b5-0543-478e-aad3-60c388fcf54a response_code = 200 uri = /v2p
23042024-11-01T22:34:09.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63238
23052024-11-01T22:34:09.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23062024-11-01T22:34:09.184ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23072024-11-01T22:34:09.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63238 req_id = b9ac062c-9a23-4b1a-b4a8-ffcf1a2b441c response_code = 204 uri = /switch-ports
23082024-11-01T22:34:09.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63238 req_id = 152e5d2f-38a6-4541-aa3e-6166b6625844 response_code = 200 uri = /network-bootstore-config
23092024-11-01T22:34:09.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
23102024-11-01T22:34:09.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65487 req_id = eafeda34-1c15-433c-bcf2-9c6ea33c083a response_code = 204 uri = /eip-gateways
23112024-11-01T22:34:09.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65487 req_id = 17cc716c-fa5c-471e-a6c4-4a78fc958ffd response_code = 204 uri = /vpc-routes
23122024-11-01T22:34:11.845ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23132024-11-01T22:34:11.846ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23142024-11-01T22:34:11.847ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23152024-11-01T22:34:11.847ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23162024-11-01T22:34:11.848ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23172024-11-01T22:34:11.849ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23182024-11-01T22:34:11.849ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23192024-11-01T22:34:11.850ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23202024-11-01T22:34:11.853ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23212024-11-01T22:34:11.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23222024-11-01T22:34:11.868ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23232024-11-01T22:34:11.869ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23242024-11-01T22:34:11.869ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23252024-11-01T22:34:11.879ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23262024-11-01T22:34:11.895ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23272024-11-01T22:34:11.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23282024-11-01T22:34:11.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23292024-11-01T22:34:11.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23302024-11-01T22:34:19.123ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36874
23312024-11-01T22:34:19.123ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36874 req_id = 5afbd34e-bb3b-4692-9ef3-c3928d6a215b response_code = 200 uri = /baseboard
23322024-11-01T22:34:21.849ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23332024-11-01T22:34:21.850ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23342024-11-01T22:34:21.851ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23352024-11-01T22:34:21.852ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23362024-11-01T22:34:21.852ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23372024-11-01T22:34:21.853ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23382024-11-01T22:34:21.853ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23392024-11-01T22:34:21.854ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23402024-11-01T22:34:21.855ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23412024-11-01T22:34:21.867ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23422024-11-01T22:34:21.870ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23432024-11-01T22:34:21.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23442024-11-01T22:34:21.872ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23452024-11-01T22:34:21.881ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23462024-11-01T22:34:21.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23472024-11-01T22:34:21.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23482024-11-01T22:34:21.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23492024-11-01T22:34:21.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23502024-11-01T22:34:31.853ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23512024-11-01T22:34:31.854ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23522024-11-01T22:34:31.855ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23532024-11-01T22:34:31.855ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23542024-11-01T22:34:31.856ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23552024-11-01T22:34:31.857ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23562024-11-01T22:34:31.857ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23572024-11-01T22:34:31.858ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23582024-11-01T22:34:31.859ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23592024-11-01T22:34:31.870ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23602024-11-01T22:34:31.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23612024-11-01T22:34:31.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23622024-11-01T22:34:31.874ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23632024-11-01T22:34:31.883ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23642024-11-01T22:34:31.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23652024-11-01T22:34:31.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23662024-11-01T22:34:31.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23672024-11-01T22:34:31.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
23682024-11-01T22:34:38.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37961
23692024-11-01T22:34:38.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37961 req_id = fab117b3-c882-49d4-bbe6-aa78a8ebf2f8 response_code = 200 uri = /vpc-routes
23702024-11-01T22:34:38.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
23712024-11-01T22:34:38.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37961 req_id = 529e7d83-b731-4b99-8872-1c4cbcba901b response_code = 204 uri = /eip-gateways
23722024-11-01T22:34:38.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37961 req_id = 54c982a0-e527-4760-8190-16b6b883cbd8 response_code = 204 uri = /vpc-routes
23732024-11-01T22:34:38.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33119
23742024-11-01T22:34:38.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33119 req_id = 19191e9e-7444-4baa-9b58-9abb9aa0d555 response_code = 200 uri = /vpc-routes
23752024-11-01T22:34:38.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59438
23762024-11-01T22:34:38.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59438 req_id = efd93636-f9c7-4bd3-a7a3-274d52dc3f5a response_code = 200 uri = /v2p
23772024-11-01T22:34:39.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
23782024-11-01T22:34:39.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33119 req_id = 848e60b2-327b-454b-9234-994c64d1b048 response_code = 204 uri = /eip-gateways
23792024-11-01T22:34:39.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53217
23802024-11-01T22:34:39.009ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23812024-11-01T22:34:39.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23822024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99505 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53217 req_id = bdcec516-8c48-4a2e-a49e-f040fbb6d0ac response_code = 204 uri = /switch-ports
23832024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35196
23842024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64518
23852024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44016
23862024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53217 req_id = 0586994f-246f-426c-a156-bb187c0c054e response_code = 200 uri = /network-bootstore-config
23872024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64518 req_id = c224d037-6db0-404b-868c-dceeeda0252f response_code = 200 uri = /v2p
23882024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33119 req_id = 5d834a3d-08f5-4f84-a598-4f376f903f48 response_code = 204 uri = /vpc-routes
23892024-11-01T22:34:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44016 req_id = 99477fb6-582c-45b6-ae31-abf9505855c4 response_code = 200 uri = /vpc-routes
23902024-11-01T22:34:39.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23912024-11-01T22:34:39.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23922024-11-01T22:34:39.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43630
23932024-11-01T22:34:39.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43630 req_id = 97ae5e2c-2b01-4a40-b32a-c026e2f016af response_code = 200 uri = /v2p
23942024-11-01T22:34:39.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45900
23952024-11-01T22:34:39.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
23962024-11-01T22:34:39.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44016 req_id = c713c60b-d4e4-418d-be13-01a81d9a1749 response_code = 204 uri = /eip-gateways
23972024-11-01T22:34:39.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108130 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35196 req_id = f161ea7a-39e8-4587-8ad8-b51e46e8cc60 response_code = 204 uri = /switch-ports
23982024-11-01T22:34:39.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23992024-11-01T22:34:39.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35196 req_id = acd966fd-fc4f-4ad3-b19f-72582bab9a72 response_code = 200 uri = /network-bootstore-config
24002024-11-01T22:34:39.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 447 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44016 req_id = 8b8f266f-2e1d-4bde-b95e-74b2325e5976 response_code = 204 uri = /vpc-routes
24012024-11-01T22:34:39.258ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24022024-11-01T22:34:39.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105400 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45900 req_id = afd8643b-6232-4698-a4e8-fc79e5095a26 response_code = 204 uri = /switch-ports
24032024-11-01T22:34:39.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45900 req_id = 050e2579-bd86-451e-b33c-045a7e02aec2 response_code = 200 uri = /network-bootstore-config
24042024-11-01T22:34:41.858ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24052024-11-01T22:34:41.859ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24062024-11-01T22:34:41.859ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24072024-11-01T22:34:41.860ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24082024-11-01T22:34:41.861ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24092024-11-01T22:34:41.861ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24102024-11-01T22:34:41.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24112024-11-01T22:34:41.863ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24122024-11-01T22:34:41.863ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24132024-11-01T22:34:41.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24142024-11-01T22:34:41.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24152024-11-01T22:34:41.874ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24162024-11-01T22:34:41.876ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24172024-11-01T22:34:41.885ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24182024-11-01T22:34:41.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24192024-11-01T22:34:41.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24202024-11-01T22:34:41.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24212024-11-01T22:34:41.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24222024-11-01T22:34:49.156ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58916
24232024-11-01T22:34:49.156ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58916 req_id = b5748403-6f56-4e5c-bc7d-b8ac7cd31e09 response_code = 200 uri = /baseboard
24242024-11-01T22:34:51.861ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24252024-11-01T22:34:51.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24262024-11-01T22:34:51.863ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24272024-11-01T22:34:51.864ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24282024-11-01T22:34:51.864ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24292024-11-01T22:34:51.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24302024-11-01T22:34:51.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24312024-11-01T22:34:51.866ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24322024-11-01T22:34:51.867ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24332024-11-01T22:34:51.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24342024-11-01T22:34:51.874ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24352024-11-01T22:34:51.877ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24362024-11-01T22:34:51.878ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24372024-11-01T22:34:51.886ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24382024-11-01T22:34:51.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24392024-11-01T22:34:51.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24402024-11-01T22:34:51.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24412024-11-01T22:34:51.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24422024-11-01T22:35:01.866ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24432024-11-01T22:35:01.867ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24442024-11-01T22:35:01.867ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24452024-11-01T22:35:01.868ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24462024-11-01T22:35:01.869ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24472024-11-01T22:35:01.870ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24482024-11-01T22:35:01.870ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24492024-11-01T22:35:01.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24502024-11-01T22:35:01.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24512024-11-01T22:35:01.875ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24522024-11-01T22:35:01.876ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24532024-11-01T22:35:01.878ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24542024-11-01T22:35:01.880ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24552024-11-01T22:35:01.889ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24562024-11-01T22:35:01.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24572024-11-01T22:35:01.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24582024-11-01T22:35:01.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24592024-11-01T22:35:01.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24602024-11-01T22:35:08.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46723
24612024-11-01T22:35:08.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46723 req_id = 320034ab-689d-429c-bb9b-6d45923e371d response_code = 200 uri = /vpc-routes
24622024-11-01T22:35:08.741ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
24632024-11-01T22:35:08.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46723 req_id = 71f19974-1218-4e34-b717-f1feea952125 response_code = 204 uri = /eip-gateways
24642024-11-01T22:35:08.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46723 req_id = c4eb2d96-d074-48d3-ad8f-7ebd85ac21ee response_code = 204 uri = /vpc-routes
24652024-11-01T22:35:08.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37679
24662024-11-01T22:35:08.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37679 req_id = e205f923-151b-4e9c-bb70-cf948ce37aaf response_code = 200 uri = /vpc-routes
24672024-11-01T22:35:08.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
24682024-11-01T22:35:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37679 req_id = de5a9ad4-8c25-4956-8b9f-c3636a245f6c response_code = 204 uri = /eip-gateways
24692024-11-01T22:35:08.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62966
24702024-11-01T22:35:08.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62966 req_id = d688bbaa-1d89-4166-8ef6-f5a0cf19f0c8 response_code = 200 uri = /v2p
24712024-11-01T22:35:08.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37679 req_id = 2d379138-b572-406d-b893-129d8e2c94f7 response_code = 204 uri = /vpc-routes
24722024-11-01T22:35:08.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44672
24732024-11-01T22:35:08.849ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24742024-11-01T22:35:08.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24752024-11-01T22:35:08.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44672 req_id = f2c4f56f-1aa6-4ad3-af31-021bf1930531 response_code = 204 uri = /switch-ports
24762024-11-01T22:35:08.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61903
24772024-11-01T22:35:08.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58291
24782024-11-01T22:35:08.952ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24792024-11-01T22:35:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61903 req_id = 07b2f58d-cfa1-4c03-aefc-6f8562f6dd4e response_code = 200 uri = /v2p
24802024-11-01T22:35:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44672 req_id = 0949b01e-c27a-4edf-bd7e-16a06b1bb6ff response_code = 200 uri = /network-bootstore-config
24812024-11-01T22:35:08.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39200
24822024-11-01T22:35:08.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39200 req_id = 6f8f042e-0b00-4549-9469-437782956a2a response_code = 200 uri = /vpc-routes
24832024-11-01T22:35:08.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24842024-11-01T22:35:09.007ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
24852024-11-01T22:35:09.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39200 req_id = 491707a7-90c8-47e2-a4f0-3c9683d12d9b response_code = 204 uri = /eip-gateways
24862024-11-01T22:35:09.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 786 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39200 req_id = 741f7d9f-9b94-400a-9d78-531834ee3a17 response_code = 204 uri = /vpc-routes
24872024-11-01T22:35:09.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61768
24882024-11-01T22:35:09.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61768 req_id = 995c8bed-6ca8-40a4-9bdd-1f88422c54cc response_code = 200 uri = /v2p
24892024-11-01T22:35:09.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54377
24902024-11-01T22:35:09.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58291 req_id = de350789-2fa6-41ed-9ccc-f9c56854326d response_code = 204 uri = /switch-ports
24912024-11-01T22:35:09.052ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24922024-11-01T22:35:09.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58291 req_id = 9544123d-a36c-4f58-8bbc-45b495e67c35 response_code = 200 uri = /network-bootstore-config
24932024-11-01T22:35:09.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24942024-11-01T22:35:09.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107786 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54377 req_id = 91281039-97e9-41e0-9916-c65e5d01d311 response_code = 204 uri = /switch-ports
24952024-11-01T22:35:09.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54377 req_id = c86a3676-041a-4299-8db3-c62a73206b89 response_code = 200 uri = /network-bootstore-config
24962024-11-01T22:35:11.869ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24972024-11-01T22:35:11.870ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24982024-11-01T22:35:11.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
24992024-11-01T22:35:11.872ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25002024-11-01T22:35:11.872ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25012024-11-01T22:35:11.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25022024-11-01T22:35:11.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25032024-11-01T22:35:11.874ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25042024-11-01T22:35:11.875ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25052024-11-01T22:35:11.876ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25062024-11-01T22:35:11.878ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25072024-11-01T22:35:11.880ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25082024-11-01T22:35:11.881ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25092024-11-01T22:35:11.891ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25102024-11-01T22:35:11.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25112024-11-01T22:35:11.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25122024-11-01T22:35:11.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25132024-11-01T22:35:11.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25142024-11-01T22:35:19.189ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49390
25152024-11-01T22:35:19.189ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49390 req_id = c8c8284f-7957-4e4c-80fa-ee9ec55930fc response_code = 200 uri = /baseboard
25162024-11-01T22:35:21.874ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25172024-11-01T22:35:21.875ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25182024-11-01T22:35:21.875ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25192024-11-01T22:35:21.876ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25202024-11-01T22:35:21.877ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25212024-11-01T22:35:21.877ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25222024-11-01T22:35:21.878ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25232024-11-01T22:35:21.878ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25242024-11-01T22:35:21.879ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25252024-11-01T22:35:21.880ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25262024-11-01T22:35:21.880ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25272024-11-01T22:35:21.883ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25282024-11-01T22:35:21.883ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25292024-11-01T22:35:21.892ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25302024-11-01T22:35:21.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25312024-11-01T22:35:21.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25322024-11-01T22:35:21.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25332024-11-01T22:35:21.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25342024-11-01T22:35:31.879ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25352024-11-01T22:35:31.879ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25362024-11-01T22:35:31.880ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25372024-11-01T22:35:31.881ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25382024-11-01T22:35:31.881ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25392024-11-01T22:35:31.882ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25402024-11-01T22:35:31.883ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25412024-11-01T22:35:31.883ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25422024-11-01T22:35:31.884ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25432024-11-01T22:35:31.884ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25442024-11-01T22:35:31.885ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25452024-11-01T22:35:31.885ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25462024-11-01T22:35:31.886ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25472024-11-01T22:35:31.894ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25482024-11-01T22:35:31.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25492024-11-01T22:35:31.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25502024-11-01T22:35:31.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25512024-11-01T22:35:31.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
25522024-11-01T22:35:38.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65172
25532024-11-01T22:35:38.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65172 req_id = f273e4ac-ef12-4ac5-8b7d-e9d39c2b58ec response_code = 200 uri = /vpc-routes
25542024-11-01T22:35:38.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36346
25552024-11-01T22:35:38.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36346 req_id = 931f73ad-92d6-4956-b679-20f844d0b7f8 response_code = 200 uri = /vpc-routes
25562024-11-01T22:35:38.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
25572024-11-01T22:35:38.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65172 req_id = 7da13555-2535-47d1-8b00-7a471c5eabbe response_code = 204 uri = /eip-gateways
25582024-11-01T22:35:38.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65172 req_id = 1180bddb-9610-4b3b-9531-bf0148ca0b40 response_code = 204 uri = /vpc-routes
25592024-11-01T22:35:39.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
25602024-11-01T22:35:39.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36346 req_id = 66cbcd24-2c84-489c-a7ee-8301dc16ff4c response_code = 204 uri = /eip-gateways
25612024-11-01T22:35:39.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34864
25622024-11-01T22:35:39.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34864 req_id = f1b02ac7-0d2f-419b-9953-0b304df2e6fc response_code = 200 uri = /vpc-routes
25632024-11-01T22:35:39.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36346 req_id = fade161a-436b-4c5f-bdfa-6bbfe3d277e1 response_code = 204 uri = /vpc-routes
25642024-11-01T22:35:39.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34804
25652024-11-01T22:35:39.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34804 req_id = 64deb067-40c7-45f1-861c-6f15d49d375e response_code = 200 uri = /v2p
25662024-11-01T22:35:39.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
25672024-11-01T22:35:39.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34864 req_id = fc3c33be-290e-49a5-a0a5-e1718d3e1638 response_code = 204 uri = /eip-gateways
25682024-11-01T22:35:39.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43183
25692024-11-01T22:35:39.088ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25702024-11-01T22:35:39.088ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25712024-11-01T22:35:39.088ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
25722024-11-01T22:35:39.090ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
25732024-11-01T22:35:39.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33139
25742024-11-01T22:35:39.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25752024-11-01T22:35:39.184ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25762024-11-01T22:35:39.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114082 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33139 req_id = 0faac11a-564d-48d2-af87-9679b21650d7 response_code = 204 uri = /switch-ports
25772024-11-01T22:35:39.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60878
25782024-11-01T22:35:39.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64914
25792024-11-01T22:35:39.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56653
25802024-11-01T22:35:39.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62760
25812024-11-01T22:35:39.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33139 req_id = 7d55f46a-4598-4e65-8cc4-3a46bf39e9b1 response_code = 200 uri = /network-bootstore-config
25822024-11-01T22:35:39.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60878 req_id = d3c109d1-fa23-4b1c-a1d3-350ff6191a4c response_code = 200 uri = /v2p
25832024-11-01T22:35:39.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 600 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34864 req_id = 2c815e8f-ce99-4a54-bae4-87e7ea542c83 response_code = 204 uri = /vpc-routes
25842024-11-01T22:35:39.255ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25852024-11-01T22:35:39.255ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25862024-11-01T22:35:39.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25872024-11-01T22:35:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25882024-11-01T22:35:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25892024-11-01T22:35:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25902024-11-01T22:35:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25912024-11-01T22:35:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25922024-11-01T22:35:39.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6439 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62760 req_id = bf733ff5-c958-46ba-8004-0e5a43e1e7f3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25932024-11-01T22:35:39.280ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25942024-11-01T22:35:39.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25952024-11-01T22:35:39.281ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
25962024-11-01T22:35:39.283ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
25972024-11-01T22:35:39.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54176
25982024-11-01T22:35:39.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8010 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54176 req_id = 4f03cd62-0a9b-4460-851a-52ee8ffc2840 response_code = 200 uri = /v2p
25992024-11-01T22:35:39.312ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26002024-11-01T22:35:39.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47605
26012024-11-01T22:35:39.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36059
26022024-11-01T22:35:39.367ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26032024-11-01T22:35:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26042024-11-01T22:35:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26052024-11-01T22:35:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26062024-11-01T22:35:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26072024-11-01T22:35:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26082024-11-01T22:35:39.367ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26092024-11-01T22:35:39.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36059 req_id = 400cfd76-4139-4bbc-9446-2ce17844e1d9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26102024-11-01T22:35:39.390ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
26112024-11-01T22:35:39.390ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
26122024-11-01T22:35:39.390ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/config/omicron-zones.json file = common/src/ledger.rs:177
26132024-11-01T22:35:39.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37725
26142024-11-01T22:35:39.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 308487 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43183 req_id = 59915390-2f14-4e39-a3c0-e47949d854f2 response_code = 200 uri = /inventory
26152024-11-01T22:35:39.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/config/omicron-zones.json file = common/src/ledger.rs:177
26162024-11-01T22:35:39.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26172024-11-01T22:35:39.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149484 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56653 req_id = 8d89f990-1483-4ab2-9150-15b48c9ef97a response_code = 204 uri = /switch-ports
26182024-11-01T22:35:39.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56653 req_id = 032880da-5557-4448-8cba-846e9da70e46 response_code = 200 uri = /network-bootstore-config
26192024-11-01T22:35:39.459ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26202024-11-01T22:35:39.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62860
26212024-11-01T22:35:39.518ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26222024-11-01T22:35:39.518ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26232024-11-01T22:35:39.518ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26242024-11-01T22:35:39.519ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26252024-11-01T22:35:39.519ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26262024-11-01T22:35:39.519ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26272024-11-01T22:35:39.519ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26282024-11-01T22:35:39.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11041 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62860 req_id = 4a5f38fd-2db9-4363-abd5-69dc63050ac4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26292024-11-01T22:35:39.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150026 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37725 req_id = f7996bc4-be54-4fe7-87a1-841bae19db47 response_code = 204 uri = /switch-ports
26302024-11-01T22:35:39.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37725 req_id = d5c3b446-7c95-45f3-acd3-ab71c2530a50 response_code = 200 uri = /network-bootstore-config
26312024-11-01T22:35:39.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 326544 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64914 req_id = e80b9384-e5fb-4add-a098-64e9b5cdf872 response_code = 200 uri = /inventory
26322024-11-01T22:35:39.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 313951 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47605 req_id = 0e048d8e-d2d9-4772-859b-51321c662c1d response_code = 200 uri = /inventory
26332024-11-01T22:35:41.883ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26342024-11-01T22:35:41.884ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26352024-11-01T22:35:41.885ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26362024-11-01T22:35:41.885ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26372024-11-01T22:35:41.886ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26382024-11-01T22:35:41.887ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26392024-11-01T22:35:41.887ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26402024-11-01T22:35:41.888ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26412024-11-01T22:35:41.889ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26422024-11-01T22:35:41.889ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26432024-11-01T22:35:41.890ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26442024-11-01T22:35:41.890ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26452024-11-01T22:35:41.891ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26462024-11-01T22:35:41.896ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26472024-11-01T22:35:41.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26482024-11-01T22:35:41.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26492024-11-01T22:35:41.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26502024-11-01T22:35:41.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26512024-11-01T22:35:49.224ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38228
26522024-11-01T22:35:49.224ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38228 req_id = 14ab05d5-f667-43f9-9fd3-2b6cbdd0d063 response_code = 200 uri = /baseboard
26532024-11-01T22:35:51.888ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26542024-11-01T22:35:51.888ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26552024-11-01T22:35:51.889ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26562024-11-01T22:35:51.890ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26572024-11-01T22:35:51.890ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26582024-11-01T22:35:51.891ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26592024-11-01T22:35:51.892ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26602024-11-01T22:35:51.892ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26612024-11-01T22:35:51.893ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26622024-11-01T22:35:51.893ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26632024-11-01T22:35:51.894ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26642024-11-01T22:35:51.894ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26652024-11-01T22:35:51.895ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26662024-11-01T22:35:51.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26672024-11-01T22:35:51.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26682024-11-01T22:35:51.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26692024-11-01T22:35:51.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26702024-11-01T22:35:51.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26712024-11-01T22:36:01.892ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26722024-11-01T22:36:01.893ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26732024-11-01T22:36:01.894ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26742024-11-01T22:36:01.895ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26752024-11-01T22:36:01.895ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26762024-11-01T22:36:01.896ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26772024-11-01T22:36:01.896ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26782024-11-01T22:36:01.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26792024-11-01T22:36:01.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26802024-11-01T22:36:01.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26812024-11-01T22:36:01.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26822024-11-01T22:36:01.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26832024-11-01T22:36:01.900ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26842024-11-01T22:36:01.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26852024-11-01T22:36:01.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26862024-11-01T22:36:01.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26872024-11-01T22:36:01.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26882024-11-01T22:36:01.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
26892024-11-01T22:36:08.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63540
26902024-11-01T22:36:08.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63540 req_id = 2c180c5a-b89e-4043-9000-4e031019de98 response_code = 200 uri = /vpc-routes
26912024-11-01T22:36:08.667ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
26922024-11-01T22:36:08.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63540 req_id = 513a08b5-bfa9-4188-908a-a099d5f2535f response_code = 204 uri = /eip-gateways
26932024-11-01T22:36:08.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63540 req_id = 851b195c-ef35-459b-8351-2c84ddda8cce response_code = 204 uri = /vpc-routes
26942024-11-01T22:36:08.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37173
26952024-11-01T22:36:08.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26962024-11-01T22:36:08.756ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26972024-11-01T22:36:08.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37173 req_id = 17c1077c-7eb3-4131-87ab-d3d138655d6a response_code = 204 uri = /switch-ports
26982024-11-01T22:36:08.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38680
26992024-11-01T22:36:08.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52822
27002024-11-01T22:36:08.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47075
27012024-11-01T22:36:08.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61122
27022024-11-01T22:36:08.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37173 req_id = e3b8e432-8353-4964-b125-874325f8d539 response_code = 200 uri = /network-bootstore-config
27032024-11-01T22:36:08.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52822 req_id = 1951f5d6-3b8e-4ec4-8aa4-3f1bc095e522 response_code = 200 uri = /vpc-routes
27042024-11-01T22:36:08.823ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27052024-11-01T22:36:08.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38680 req_id = ec91d19a-4612-4874-a647-1c4e28571d09 response_code = 200 uri = /v2p
27062024-11-01T22:36:08.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47075 req_id = d1be411f-8161-4548-a0b9-045fc86b017b response_code = 200 uri = /v2p
27072024-11-01T22:36:08.843ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
27082024-11-01T22:36:08.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 606 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52822 req_id = 48645b02-e842-4207-adb8-618a32eecddb response_code = 204 uri = /eip-gateways
27092024-11-01T22:36:08.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52822 req_id = 896a4337-7778-4bd8-88b9-a0019d8819bd response_code = 204 uri = /vpc-routes
27102024-11-01T22:36:08.866ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27112024-11-01T22:36:08.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61122 req_id = ca138b36-ae91-46df-9236-bf288f862aaa response_code = 204 uri = /switch-ports
27122024-11-01T22:36:08.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61122 req_id = 93717c3f-82d2-43d5-a94f-fbc7809ff1bc response_code = 200 uri = /network-bootstore-config
27132024-11-01T22:36:08.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44022
27142024-11-01T22:36:08.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44022 req_id = 2979388a-99ba-4606-8678-f35f01545cef response_code = 200 uri = /vpc-routes
27152024-11-01T22:36:09.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
27162024-11-01T22:36:09.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44022 req_id = 3d24c71e-9a0f-4806-8c46-e8ea5f312ff5 response_code = 204 uri = /eip-gateways
27172024-11-01T22:36:09.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44022 req_id = 8280ea47-f4ac-4a52-9f4e-972ad47f57cd response_code = 204 uri = /vpc-routes
27182024-11-01T22:36:09.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60633
27192024-11-01T22:36:09.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60633 req_id = 656626a0-7397-49c5-a752-a3c4127f9671 response_code = 200 uri = /v2p
27202024-11-01T22:36:09.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46403
27212024-11-01T22:36:09.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27222024-11-01T22:36:09.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27232024-11-01T22:36:09.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46403 req_id = 32aa1d5b-e453-4180-b0aa-cacf505571d9 response_code = 204 uri = /switch-ports
27242024-11-01T22:36:09.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46403 req_id = a8d2ba05-6768-41a0-b28b-aac774716f8f response_code = 200 uri = /network-bootstore-config
27252024-11-01T22:36:11.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27262024-11-01T22:36:11.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27272024-11-01T22:36:11.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27282024-11-01T22:36:11.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27292024-11-01T22:36:11.900ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27302024-11-01T22:36:11.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27312024-11-01T22:36:11.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27322024-11-01T22:36:11.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27332024-11-01T22:36:11.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27342024-11-01T22:36:11.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27352024-11-01T22:36:11.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27362024-11-01T22:36:11.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27372024-11-01T22:36:11.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27382024-11-01T22:36:11.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27392024-11-01T22:36:11.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27402024-11-01T22:36:11.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27412024-11-01T22:36:11.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27422024-11-01T22:36:11.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27432024-11-01T22:36:19.257ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55986
27442024-11-01T22:36:19.257ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55986 req_id = d5283607-7345-4c8a-928f-6444f156c869 response_code = 200 uri = /baseboard
27452024-11-01T22:36:21.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27462024-11-01T22:36:21.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27472024-11-01T22:36:21.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27482024-11-01T22:36:21.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27492024-11-01T22:36:21.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27502024-11-01T22:36:21.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27512024-11-01T22:36:21.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27522024-11-01T22:36:21.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27532024-11-01T22:36:21.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27542024-11-01T22:36:21.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27552024-11-01T22:36:21.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27562024-11-01T22:36:21.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27572024-11-01T22:36:21.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27582024-11-01T22:36:21.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27592024-11-01T22:36:21.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27602024-11-01T22:36:21.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27612024-11-01T22:36:21.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27622024-11-01T22:36:21.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27632024-11-01T22:36:31.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27642024-11-01T22:36:31.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27652024-11-01T22:36:31.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27662024-11-01T22:36:31.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27672024-11-01T22:36:31.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27682024-11-01T22:36:31.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27692024-11-01T22:36:31.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27702024-11-01T22:36:31.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27712024-11-01T22:36:31.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27722024-11-01T22:36:31.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27732024-11-01T22:36:31.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27742024-11-01T22:36:31.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27752024-11-01T22:36:31.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27762024-11-01T22:36:31.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27772024-11-01T22:36:31.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27782024-11-01T22:36:31.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27792024-11-01T22:36:31.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27802024-11-01T22:36:31.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
27812024-11-01T22:36:38.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52045
27822024-11-01T22:36:38.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52045 req_id = 4d66ddfc-34b7-471b-a2f6-2a50e974a638 response_code = 200 uri = /vpc-routes
27832024-11-01T22:36:38.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43463
27842024-11-01T22:36:38.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43463 req_id = 4071a6ea-e881-4ae7-9263-da39a91929a7 response_code = 200 uri = /v2p
27852024-11-01T22:36:38.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
27862024-11-01T22:36:38.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52045 req_id = cce05795-3ca7-4f50-bb59-628dd9f18f2c response_code = 204 uri = /eip-gateways
27872024-11-01T22:36:38.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52045 req_id = 3eaf8413-440f-4f36-a1e1-3a84e3cecfc2 response_code = 204 uri = /vpc-routes
27882024-11-01T22:36:38.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62351
27892024-11-01T22:36:38.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62351 req_id = 41698983-e0a8-41af-b2d1-cc0784f52dc1 response_code = 200 uri = /vpc-routes
27902024-11-01T22:36:38.929ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
27912024-11-01T22:36:38.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62351 req_id = 22336b37-48f3-4f32-af47-68af74690b4b response_code = 204 uri = /eip-gateways
27922024-11-01T22:36:38.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62351 req_id = 9df6467b-fb97-4d34-9364-08ee62b7bda2 response_code = 204 uri = /vpc-routes
27932024-11-01T22:36:38.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63108
27942024-11-01T22:36:38.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63108 req_id = b053962a-b886-49e6-a1fd-55a03f73327e response_code = 200 uri = /vpc-routes
27952024-11-01T22:36:39.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42017
27962024-11-01T22:36:39.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42017 req_id = ab778aad-2d02-422e-a45d-9f78622827b6 response_code = 200 uri = /v2p
27972024-11-01T22:36:39.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60570
27982024-11-01T22:36:39.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27992024-11-01T22:36:39.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28002024-11-01T22:36:39.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121916 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60570 req_id = 67860ac7-91b1-45f7-be99-55b003e7690e response_code = 204 uri = /switch-ports
28012024-11-01T22:36:39.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41513
28022024-11-01T22:36:39.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
28032024-11-01T22:36:39.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63108 req_id = 01d11fe4-c4b1-4d8b-8f23-d29553fe57b5 response_code = 204 uri = /eip-gateways
28042024-11-01T22:36:39.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28052024-11-01T22:36:39.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60570 req_id = db33bad7-98e7-4282-b2df-35d41da85205 response_code = 200 uri = /network-bootstore-config
28062024-11-01T22:36:39.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28072024-11-01T22:36:39.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49451
28082024-11-01T22:36:39.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49451 req_id = c6f22544-3900-4b7d-a148-a26603efcc2f response_code = 200 uri = /v2p
28092024-11-01T22:36:39.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63108 req_id = d41ae1aa-e392-47e3-8fd0-2de591199e47 response_code = 204 uri = /vpc-routes
28102024-11-01T22:36:39.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41513 req_id = c53e8c95-7445-4f60-aba3-5b646645432d response_code = 204 uri = /switch-ports
28112024-11-01T22:36:39.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41513 req_id = 27626aa9-ad54-4f7a-a92f-482c8a9730e8 response_code = 200 uri = /network-bootstore-config
28122024-11-01T22:36:39.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52338
28132024-11-01T22:36:39.257ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28142024-11-01T22:36:39.294ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28152024-11-01T22:36:39.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52338 req_id = 1775f7ed-ca8a-4de8-8153-78fc91baa123 response_code = 204 uri = /switch-ports
28162024-11-01T22:36:39.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52338 req_id = bea33693-1b3d-4562-a5e3-99d35c95933b response_code = 200 uri = /network-bootstore-config
28172024-11-01T22:36:41.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28182024-11-01T22:36:41.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28192024-11-01T22:36:41.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28202024-11-01T22:36:41.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28212024-11-01T22:36:41.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28222024-11-01T22:36:41.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28232024-11-01T22:36:41.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28242024-11-01T22:36:41.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28252024-11-01T22:36:41.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28262024-11-01T22:36:41.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28272024-11-01T22:36:41.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28282024-11-01T22:36:41.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28292024-11-01T22:36:41.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28302024-11-01T22:36:41.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28312024-11-01T22:36:41.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28322024-11-01T22:36:41.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28332024-11-01T22:36:41.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28342024-11-01T22:36:41.955ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28352024-11-01T22:36:49.292ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43676
28362024-11-01T22:36:49.292ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43676 req_id = c4094b1a-51ce-4149-b4ad-69adc2709d90 response_code = 200 uri = /baseboard
28372024-11-01T22:36:51.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28382024-11-01T22:36:51.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28392024-11-01T22:36:51.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28402024-11-01T22:36:51.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28412024-11-01T22:36:51.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28422024-11-01T22:36:51.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28432024-11-01T22:36:51.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28442024-11-01T22:36:51.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28452024-11-01T22:36:51.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28462024-11-01T22:36:51.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28472024-11-01T22:36:51.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28482024-11-01T22:36:51.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28492024-11-01T22:36:51.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28502024-11-01T22:36:51.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28512024-11-01T22:36:51.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28522024-11-01T22:36:51.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28532024-11-01T22:36:51.959ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28542024-11-01T22:36:51.960ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28552024-11-01T22:37:01.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28562024-11-01T22:37:01.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28572024-11-01T22:37:01.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28582024-11-01T22:37:01.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28592024-11-01T22:37:01.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28602024-11-01T22:37:01.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28612024-11-01T22:37:01.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28622024-11-01T22:37:01.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28632024-11-01T22:37:01.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28642024-11-01T22:37:01.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28652024-11-01T22:37:01.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28662024-11-01T22:37:01.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28672024-11-01T22:37:01.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28682024-11-01T22:37:01.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28692024-11-01T22:37:01.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28702024-11-01T22:37:01.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28712024-11-01T22:37:01.962ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28722024-11-01T22:37:01.962ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
28732024-11-01T22:37:08.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36558
28742024-11-01T22:37:08.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36558 req_id = e08b62e4-086e-4549-a709-d7a41ab9415e response_code = 200 uri = /v2p
28752024-11-01T22:37:08.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65428
28762024-11-01T22:37:08.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65428 req_id = f056ad12-7397-402a-9a39-6ba0e1c11ed2 response_code = 200 uri = /vpc-routes
28772024-11-01T22:37:08.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45888
28782024-11-01T22:37:08.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45888 req_id = e0103d0d-3d32-4a60-831c-350f51604f3a response_code = 200 uri = /v2p
28792024-11-01T22:37:08.790ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
28802024-11-01T22:37:08.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65428 req_id = e92b276e-7b94-463b-8632-85fe6379c727 response_code = 204 uri = /eip-gateways
28812024-11-01T22:37:08.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38759
28822024-11-01T22:37:08.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38759 req_id = 8b8891d7-b482-466c-b5c8-d03d2901270e response_code = 200 uri = /vpc-routes
28832024-11-01T22:37:08.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65428 req_id = 5433ba46-a117-4152-8ae8-66b5f3dc97db response_code = 204 uri = /vpc-routes
28842024-11-01T22:37:08.805ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
28852024-11-01T22:37:08.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38759 req_id = bc9e5f6a-05a4-457d-b18f-77e1633f3af9 response_code = 204 uri = /eip-gateways
28862024-11-01T22:37:08.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38759 req_id = b08a965b-81ac-47c7-8d3c-1f2eefd0067e response_code = 204 uri = /vpc-routes
28872024-11-01T22:37:08.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56248
28882024-11-01T22:37:08.842ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28892024-11-01T22:37:08.885ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28902024-11-01T22:37:08.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56248 req_id = da0a9f83-396f-4f9f-a65e-c2303b624718 response_code = 204 uri = /switch-ports
28912024-11-01T22:37:08.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55344
28922024-11-01T22:37:08.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42970
28932024-11-01T22:37:08.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42970 req_id = 18cd061d-c973-4c0b-b8d8-26ee6d16e343 response_code = 200 uri = /vpc-routes
28942024-11-01T22:37:08.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56248 req_id = 7d6dc189-8c54-4e93-ab71-54bbe7b901af response_code = 200 uri = /network-bootstore-config
28952024-11-01T22:37:08.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28962024-11-01T22:37:08.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
28972024-11-01T22:37:08.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42970 req_id = c52b304d-a1a7-434a-b435-f49d0f7954c7 response_code = 204 uri = /eip-gateways
28982024-11-01T22:37:09.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28992024-11-01T22:37:09.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42970 req_id = 4b771501-dce9-4f7f-b58c-6519b46c527c response_code = 204 uri = /vpc-routes
29002024-11-01T22:37:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55344 req_id = 7346a20c-4e02-4d0e-b970-6f6b07ec564c response_code = 204 uri = /switch-ports
29012024-11-01T22:37:09.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55344 req_id = 5a4904f8-b51f-4778-93f2-74d5e1c5284f response_code = 200 uri = /network-bootstore-config
29022024-11-01T22:37:09.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59273
29032024-11-01T22:37:09.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59273 req_id = f7ab561e-8e9d-4408-9309-ad0bcee6d6d4 response_code = 200 uri = /v2p
29042024-11-01T22:37:09.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56605
29052024-11-01T22:37:09.079ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29062024-11-01T22:37:09.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29072024-11-01T22:37:09.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56605 req_id = b04a4e02-f4fe-4c9e-901e-4c5b6162d02f response_code = 204 uri = /switch-ports
29082024-11-01T22:37:09.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56605 req_id = bedb30cf-7907-47c2-a748-715db8c66565 response_code = 200 uri = /network-bootstore-config
29092024-11-01T22:37:11.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29102024-11-01T22:37:11.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29112024-11-01T22:37:11.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29122024-11-01T22:37:11.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29132024-11-01T22:37:11.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29142024-11-01T22:37:11.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29152024-11-01T22:37:11.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29162024-11-01T22:37:11.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29172024-11-01T22:37:11.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29182024-11-01T22:37:11.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29192024-11-01T22:37:11.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29202024-11-01T22:37:11.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29212024-11-01T22:37:11.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29222024-11-01T22:37:11.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29232024-11-01T22:37:11.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29242024-11-01T22:37:11.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29252024-11-01T22:37:11.963ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29262024-11-01T22:37:11.964ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29272024-11-01T22:37:19.326ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48713
29282024-11-01T22:37:19.326ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48713 req_id = 3a4159ed-7c6d-48a5-8006-f35dbf4e623b response_code = 200 uri = /baseboard
29292024-11-01T22:37:21.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29302024-11-01T22:37:21.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29312024-11-01T22:37:21.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29322024-11-01T22:37:21.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29332024-11-01T22:37:21.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29342024-11-01T22:37:21.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29352024-11-01T22:37:21.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29362024-11-01T22:37:21.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29372024-11-01T22:37:21.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29382024-11-01T22:37:21.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29392024-11-01T22:37:21.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29402024-11-01T22:37:21.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29412024-11-01T22:37:21.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29422024-11-01T22:37:21.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29432024-11-01T22:37:21.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29442024-11-01T22:37:21.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29452024-11-01T22:37:21.965ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29462024-11-01T22:37:21.965ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29472024-11-01T22:37:28.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56984
29482024-11-01T22:37:28.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56984 req_id = fb1a7734-00ae-4002-840c-a2e5b6b9a03d response_code = 200 uri = /v2p
29492024-11-01T22:37:28.502ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(10032583) }
29502024-11-01T22:37:28.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2736 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56984 req_id = ae4f105b-a2b2-4956-868d-422a9c2a79d2 response_code = 204 uri = /v2p
29512024-11-01T22:37:28.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53160
29522024-11-01T22:37:28.649ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10032583))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-71fb5cf826c", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 89f6fa37-4d91-4a6e-b507-9dd0834378b7, read_only_parent: Some(Volume { block_size: 512, id: 51517740-616b-41eb-9897-129d6b9e747c, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1f778c1b-7de6-4a6e-88cb-1c81830eb681, key: Some("Bvq71yZez9PyC8NQrgj0qXYYowTZCdVojZnH6zZLw8A="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 89f6fa37-4d91-4a6e-b507-9dd0834378b7, key: Some("YNtVonJ3+P3sc2kWyedBhumlnoDCNRqPYPpkL/hhgj4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-71fb5cf826c" }] }), cloud_init_bytes: Some(..) } instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 metadata = InstanceMetadata { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, project_id: 9c656347-b114-4a0a-996c-a291e53e2e71 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-01T22:37:28.640300510Z }
29532024-11-01T22:37:28.649ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 migration_id = None propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29542024-11-01T22:37:28.650ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 migration_id = None propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10032583))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e9f5571-e781-4a75-94cd-0a88bf8f6fc8, kind: Instance { id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10032583), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-71fb5cf826c", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 89f6fa37-4d91-4a6e-b507-9dd0834378b7, read_only_parent: Some(Volume { block_size: 512, id: 51517740-616b-41eb-9897-129d6b9e747c, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1f778c1b-7de6-4a6e-88cb-1c81830eb681, key: Some("Bvq71yZez9PyC8NQrgj0qXYYowTZCdVojZnH6zZLw8A="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 89f6fa37-4d91-4a6e-b507-9dd0834378b7, key: Some("YNtVonJ3+P3sc2kWyedBhumlnoDCNRqPYPpkL/hhgj4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-71fb5cf826c" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-01T22:37:28.640300510Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29552024-11-01T22:37:28.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53160 req_id = 09a149f1-25a1-4f6a-9f6a-e2277bcfae1c response_code = 200 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
29562024-11-01T22:37:28.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37826
29572024-11-01T22:37:28.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1584 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37826 req_id = 4c0f557f-c251-4774-a223-71318cb4c15e response_code = 200 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c/state
29582024-11-01T22:37:28.746ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 10032583 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29592024-11-01T22:37:28.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
29602024-11-01T22:37:28.791ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c file = illumos-utils/src/zone.rs:325 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29612024-11-01T22:37:28.816ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c file = illumos-utils/src/zone.rs:363 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29622024-11-01T22:37:28.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50937
29632024-11-01T22:37:28.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50937 req_id = 5ff65aae-dd11-4b1d-addc-fd7cdb6e33e9 response_code = 200 uri = /vpc-routes
29642024-11-01T22:37:28.845ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {0e9f5571-e781-4a75-94cd-0a88bf8f6fc8: {10.151.2.175: {893251ad-179c-4c9a-a677-7fc39b345d64}, 10.151.2.176: {893251ad-179c-4c9a-a677-7fc39b345d64}}} }
29652024-11-01T22:37:30.268ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29662024-11-01T22:37:30.268ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c zone file = illumos-utils/src/running_zone.rs:488 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29672024-11-01T22:37:30.510ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 52.400144ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29682024-11-01T22:37:30.582ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 96.113566ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29692024-11-01T22:37:30.697ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 234.838622ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29702024-11-01T22:37:30.946ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 213.811007ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29712024-11-01T22:37:31.176ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 1.036543275s file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29722024-11-01T22:37:31.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29732024-11-01T22:37:31.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29742024-11-01T22:37:31.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29752024-11-01T22:37:31.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29762024-11-01T22:37:31.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29772024-11-01T22:37:31.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29782024-11-01T22:37:31.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29792024-11-01T22:37:31.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29802024-11-01T22:37:31.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29812024-11-01T22:37:31.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29822024-11-01T22:37:31.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29832024-11-01T22:37:31.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29842024-11-01T22:37:31.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29852024-11-01T22:37:31.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29862024-11-01T22:37:31.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29872024-11-01T22:37:31.956ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29882024-11-01T22:37:31.966ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29892024-11-01T22:37:31.967ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
29902024-11-01T22:37:32.228ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 1.276059393s file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29912024-11-01T22:37:33.517ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 1.14867705s file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29922024-11-01T22:37:34.679ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 746.706449ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c zone = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
29932024-11-01T22:37:35.459ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c file = sled-agent/src/instance.rs:1787 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29942024-11-01T22:37:35.470ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 47.145304ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29952024-11-01T22:37:35.530ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 52.234367ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29962024-11-01T22:37:35.595ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 273.005174ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29972024-11-01T22:37:35.881ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c") failed: Property not found. retry in 556.581627ms file = illumos-utils/src/svc.rs:36 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29982024-11-01T22:37:36.450ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
29992024-11-01T22:37:36.487ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30002024-11-01T22:37:36.625ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30012024-11-01T22:37:36.625ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30022024-11-01T22:37:36.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7780308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50937 req_id = ead60030-0abd-4149-9d61-7987bf028fdd response_code = 204 uri = /eip-gateways
30032024-11-01T22:37:36.628ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-01T22:37:36.628462809Z } file = sled-agent/src/instance.rs:780 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30042024-11-01T22:37:36.628ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T22:37:36.628462809Z } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30052024-11-01T22:37:36.628ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T22:37:36.628462809Z }, migration_in: None, migration_out: None }
30062024-11-01T22:37:36.643ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-01T22:37:36.643858296Z } file = sled-agent/src/instance.rs:780 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30072024-11-01T22:37:36.643ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T22:37:36.643858296Z } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30082024-11-01T22:37:36.643ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T22:37:36.643858296Z }, migration_in: None, migration_out: None }
30092024-11-01T22:37:36.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50937 req_id = f2b1cb4d-fbe6-4784-97a0-2b3e89b7b898 response_code = 204 uri = /vpc-routes
30102024-11-01T22:37:38.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37137
30112024-11-01T22:37:38.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37137 req_id = d80a67d5-9bea-4049-b93c-e1a39bdb11eb response_code = 200 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c/state
30122024-11-01T22:37:38.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54136
30132024-11-01T22:37:38.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54136 req_id = 5504d5cb-c261-4da7-8376-916474490bc8 response_code = 200 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c/state
30142024-11-01T22:37:38.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54597
30152024-11-01T22:37:38.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54597 req_id = e39423f4-ab58-471a-9791-2fea3a2725b1 response_code = 200 uri = /v2p
30162024-11-01T22:37:38.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60646
30172024-11-01T22:37:38.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60646 req_id = c13b7a1a-d7a4-473e-96ce-767cf8d67c8c response_code = 200 uri = /vpc-routes
30182024-11-01T22:37:38.956ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {0e9f5571-e781-4a75-94cd-0a88bf8f6fc8: {10.151.2.176: {893251ad-179c-4c9a-a677-7fc39b345d64}, 10.151.2.175: {893251ad-179c-4c9a-a677-7fc39b345d64}}} }
30192024-11-01T22:37:38.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60646 req_id = afa2889b-78b6-45d9-ac20-27c5a83acef3 response_code = 204 uri = /eip-gateways
30202024-11-01T22:37:38.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42714
30212024-11-01T22:37:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42714 req_id = 19e1bb66-35bf-46f5-949b-d58859337dcf response_code = 200 uri = /vpc-routes
30222024-11-01T22:37:38.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60646 req_id = 6c16f317-7102-4b38-b5c3-a6d61e619ccd response_code = 204 uri = /vpc-routes
30232024-11-01T22:37:39.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61730
30242024-11-01T22:37:39.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61730 req_id = 8b6dfb4f-fd94-48b3-90df-43ad5d67a1ed response_code = 200 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c/state
30252024-11-01T22:37:39.031ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {0e9f5571-e781-4a75-94cd-0a88bf8f6fc8: {10.151.2.176: {893251ad-179c-4c9a-a677-7fc39b345d64}, 10.151.2.175: {893251ad-179c-4c9a-a677-7fc39b345d64}}} }
30262024-11-01T22:37:39.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42714 req_id = f534d983-1381-4b40-aa1f-0f0e66a35e3d response_code = 204 uri = /eip-gateways
30272024-11-01T22:37:39.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42714 req_id = ca64a9e6-d317-4ebf-b22e-de4026d0e302 response_code = 204 uri = /vpc-routes
30282024-11-01T22:37:39.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55121
30292024-11-01T22:37:39.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
30302024-11-01T22:37:39.133ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
30312024-11-01T22:37:39.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55121 req_id = 3ea68995-df71-425f-9c3c-0a469ff7eb8d response_code = 204 uri = /switch-ports
30322024-11-01T22:37:39.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41127
30332024-11-01T22:37:39.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56912
30342024-11-01T22:37:39.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44861
30352024-11-01T22:37:39.219ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
30362024-11-01T22:37:39.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55121 req_id = 88dfef9f-3cc5-47cf-ac2e-ce947f17a480 response_code = 200 uri = /network-bootstore-config
30372024-11-01T22:37:39.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41127 req_id = b28bc0e8-0e07-4d5c-b560-4f2b5e750809 response_code = 200 uri = /v2p
30382024-11-01T22:37:39.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56912 req_id = b981150b-902f-4aac-8b75-1963fb402b8e response_code = 200 uri = /v2p
30392024-11-01T22:37:39.263ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
30402024-11-01T22:37:39.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44962
30412024-11-01T22:37:39.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4526 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44962 req_id = 2ea647ba-564b-4bea-b78d-8ae417c0875f response_code = 200 uri = /vpc-routes
30422024-11-01T22:37:39.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {0e9f5571-e781-4a75-94cd-0a88bf8f6fc8: {10.151.2.176: {893251ad-179c-4c9a-a677-7fc39b345d64}, 10.151.2.175: {893251ad-179c-4c9a-a677-7fc39b345d64}}} }
30432024-11-01T22:37:39.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44962 req_id = 5293892f-ea00-4202-938f-8e2e0fb769e9 response_code = 204 uri = /eip-gateways
30442024-11-01T22:37:39.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44861 req_id = e3e652b0-4764-4ab8-8bc4-3937af0a1dee response_code = 204 uri = /switch-ports
30452024-11-01T22:37:39.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44861 req_id = 1c08308f-07a1-43ad-bca3-008a2388a720 response_code = 200 uri = /network-bootstore-config
30462024-11-01T22:37:39.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44962 req_id = 832f72dc-44f4-472a-ac63-aa92a839f05a response_code = 204 uri = /vpc-routes
30472024-11-01T22:37:39.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52383
30482024-11-01T22:37:39.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
30492024-11-01T22:37:39.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
30502024-11-01T22:37:39.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52383 req_id = 85339412-fa9c-44ff-8389-d066bcbac853 response_code = 204 uri = /switch-ports
30512024-11-01T22:37:39.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52383 req_id = 183d5bc2-41cd-4538-95e3-b329bb67a1ff response_code = 200 uri = /network-bootstore-config
30522024-11-01T22:37:41.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30532024-11-01T22:37:41.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30542024-11-01T22:37:41.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30552024-11-01T22:37:41.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30562024-11-01T22:37:41.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30572024-11-01T22:37:41.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30582024-11-01T22:37:41.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30592024-11-01T22:37:41.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30602024-11-01T22:37:41.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30612024-11-01T22:37:41.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30622024-11-01T22:37:41.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30632024-11-01T22:37:41.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30642024-11-01T22:37:41.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30652024-11-01T22:37:41.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30662024-11-01T22:37:41.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30672024-11-01T22:37:41.958ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30682024-11-01T22:37:41.968ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30692024-11-01T22:37:41.969ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30702024-11-01T22:37:46.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53862
30712024-11-01T22:37:46.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 584 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53862 req_id = ee6a52d4-abc7-445a-a55a-9e8ae6638ee2 response_code = 200 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c/state
30722024-11-01T22:37:46.586ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-01T22:37:46.586558330Z } file = sled-agent/src/instance.rs:780 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30732024-11-01T22:37:46.586ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T22:37:46.586558330Z } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30742024-11-01T22:37:46.586ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T22:37:46.586558330Z }, migration_in: None, migration_out: None }
30752024-11-01T22:37:46.598ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-01T22:37:46.598960355Z } file = sled-agent/src/instance.rs:780 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30762024-11-01T22:37:46.598ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-01T22:37:46.598960355Z } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30772024-11-01T22:37:46.599ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30782024-11-01T22:37:46.599ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30792024-11-01T22:37:46.599ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 5713045386288471395 n_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30802024-11-01T22:37:46.599ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 6264983313163775588 n_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30812024-11-01T22:37:46.599ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30822024-11-01T22:37:46.599ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/7c5f9864-841c-4f7e-9e04-b5d261faabe5/debug/bundle/zone", "/pool/int/de1f5fdd-2bbd-4eb3-94a0-6008b930cced/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/01974938-4423-4d00-8483-e32aa45bba65/crypt/debug", "/pool/ext/b584fadd-38ce-4107-970b-85f46f61dadb/crypt/debug", "/pool/ext/768cd5c9-c954-41f2-a65d-7a379e2ab256/crypt/debug", "/pool/ext/db20314d-42b2-4943-87a6-6fa7beadbeba/crypt/debug", "/pool/ext/97002ab6-ec54-479c-a9fd-59dd0b329ec7/crypt/debug", "/pool/ext/4084e05d-3d12-4c0d-8aa6-ba2cf8744980/crypt/debug", "/pool/ext/7c09bb29-fa72-45dc-9742-d80c9c813ff8/crypt/debug", "/pool/ext/d8faf4d5-70b3-44f8-a758-7d72b3e12d0a/crypt/debug", "/pool/ext/e70fce64-69d1-485f-8e45-53cfedf62cb4/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c
30832024-11-01T22:37:47.226ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c", bundle_id: c3c3b397-8ade-43f8-91a9-bfdc6142cb21 }, time_created: 2024-11-01T22:37:46.601622745Z, version: 0, cause: TerminatedInstance }
30842024-11-01T22:37:47.226ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_4faf19ea-eea1-4ef6-8607-11b243720a1c file = sled-agent/src/instance.rs:1032 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30852024-11-01T22:37:49.006ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30862024-11-01T22:37:49.026ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(10032583), kind: System }
30872024-11-01T22:37:49.026ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(10032583), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30882024-11-01T22:37:49.026ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T22:37:49.026950347Z }, migration_in: None, migration_out: None }
30892024-11-01T22:37:49.055ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T22:37:49.026950347Z }, migration_in: None, migration_out: None }
30902024-11-01T22:37:49.057ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
30912024-11-01T22:37:49.361ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35371
30922024-11-01T22:37:49.361ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35371 req_id = ce8eebe8-1cb1-4981-9008-daa95e357d90 response_code = 200 uri = /baseboard
30932024-11-01T22:37:49.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42401
30942024-11-01T22:37:49.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42401 req_id = a8bd4497-f7e1-41cf-96d9-794108ac48a4 response_code = 200 uri = /vpc-routes
30952024-11-01T22:37:49.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
30962024-11-01T22:37:49.629ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
30972024-11-01T22:37:49.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42401 req_id = 35f2bb7e-a5d8-420c-b299-591e62b54f67 response_code = 204 uri = /eip-gateways
30982024-11-01T22:37:49.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42401 req_id = 70f4d01c-b72f-41ac-a3d5-75a4356fb30a response_code = 204 uri = /vpc-routes
30992024-11-01T22:37:49.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34097
31002024-11-01T22:37:49.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34097 req_id = 2dc5582f-f319-4849-8eb9-25c4aa0d2d44 response_code = 200 uri = /v2p
31012024-11-01T22:37:49.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61030
31022024-11-01T22:37:49.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61030 req_id = 04ad496f-2d44-47d3-9e88-cae10fa34008 response_code = 200 uri = /v2p
31032024-11-01T22:37:49.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51587
31042024-11-01T22:37:49.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51587 req_id = 35d9efff-5467-493c-ae26-e52f37748667 response_code = 200 uri = /vpc-routes
31052024-11-01T22:37:49.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
31062024-11-01T22:37:49.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51587 req_id = a561ed59-b575-4aaf-a6aa-1b4cda4db789 response_code = 204 uri = /eip-gateways
31072024-11-01T22:37:49.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51587 req_id = e4d74fbe-53c7-4bab-8dad-88644ff6af69 response_code = 204 uri = /vpc-routes
31082024-11-01T22:37:50.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47980
31092024-11-01T22:37:50.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47980 req_id = 8bcbf7f4-2882-48b1-abad-0877ca4761f7 response_code = 200 uri = /vpc-routes
31102024-11-01T22:37:50.621ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
31112024-11-01T22:37:50.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47980 req_id = 4f353990-41a0-43cf-a6dd-c1477838796f response_code = 204 uri = /eip-gateways
31122024-11-01T22:37:50.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47980 req_id = ce75816d-8278-4a7e-83f4-f577c5f73134 response_code = 204 uri = /vpc-routes
31132024-11-01T22:37:51.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31142024-11-01T22:37:51.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31152024-11-01T22:37:51.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31162024-11-01T22:37:51.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31172024-11-01T22:37:51.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31182024-11-01T22:37:51.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31192024-11-01T22:37:51.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31202024-11-01T22:37:51.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31212024-11-01T22:37:51.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31222024-11-01T22:37:51.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31232024-11-01T22:37:51.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31242024-11-01T22:37:51.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31252024-11-01T22:37:51.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31262024-11-01T22:37:51.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31272024-11-01T22:37:51.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31282024-11-01T22:37:51.960ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31292024-11-01T22:37:51.971ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31302024-11-01T22:37:51.971ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31312024-11-01T22:38:01.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31322024-11-01T22:38:01.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31332024-11-01T22:38:01.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31342024-11-01T22:38:01.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31352024-11-01T22:38:01.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31362024-11-01T22:38:01.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31372024-11-01T22:38:01.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31382024-11-01T22:38:01.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31392024-11-01T22:38:01.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31402024-11-01T22:38:01.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31412024-11-01T22:38:01.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31422024-11-01T22:38:01.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31432024-11-01T22:38:01.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31442024-11-01T22:38:01.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31452024-11-01T22:38:01.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31462024-11-01T22:38:01.961ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31472024-11-01T22:38:01.972ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31482024-11-01T22:38:01.973ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31492024-11-01T22:38:08.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51362
31502024-11-01T22:38:08.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51362 req_id = 3582ff88-b4fd-49c7-9b69-057fa263b1a8 response_code = 200 uri = /vpc-routes
31512024-11-01T22:38:08.695ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
31522024-11-01T22:38:08.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51362 req_id = d930561a-806b-483f-8ad8-eb21f736d7a9 response_code = 204 uri = /eip-gateways
31532024-11-01T22:38:08.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51362 req_id = 268f1207-d22e-4f88-9b4c-496613997d53 response_code = 204 uri = /vpc-routes
31542024-11-01T22:38:08.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44028
31552024-11-01T22:38:08.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
31562024-11-01T22:38:08.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
31572024-11-01T22:38:08.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44028 req_id = cb6d3d59-0a60-4d15-a613-bd96190f34f7 response_code = 204 uri = /switch-ports
31582024-11-01T22:38:08.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43307
31592024-11-01T22:38:08.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33303
31602024-11-01T22:38:08.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63608
31612024-11-01T22:38:08.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
31622024-11-01T22:38:08.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44028 req_id = d9b7f521-b967-4588-a7bb-1c6eb86f2032 response_code = 200 uri = /network-bootstore-config
31632024-11-01T22:38:08.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43307 req_id = af540c83-db13-43e9-a39a-30225b24fa07 response_code = 200 uri = /vpc-routes
31642024-11-01T22:38:08.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6450 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33303 req_id = df6ff1cb-c1af-44e5-8331-ccca82e7d2f5 response_code = 200 uri = /v2p
31652024-11-01T22:38:08.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42256
31662024-11-01T22:38:08.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42256 req_id = 40f552d2-3182-4533-829c-77de9d63d325 response_code = 200 uri = /v2p
31672024-11-01T22:38:08.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
31682024-11-01T22:38:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43307 req_id = afdb993a-72bb-487e-ad9d-eb1d334351e9 response_code = 204 uri = /eip-gateways
31692024-11-01T22:38:08.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51405
31702024-11-01T22:38:08.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51405 req_id = d561e9e5-bbfe-495d-a1c7-672379989469 response_code = 200 uri = /vpc-routes
31712024-11-01T22:38:08.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
31722024-11-01T22:38:08.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 893 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43307 req_id = 7560f1b1-46ff-429c-a98e-228a24aab3a3 response_code = 204 uri = /vpc-routes
31732024-11-01T22:38:08.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 values = ExternalIpGatewayMap { mappings: {} }
31742024-11-01T22:38:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 565 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51405 req_id = a44e297f-08ac-429a-8127-b6b38f1749a4 response_code = 204 uri = /eip-gateways
31752024-11-01T22:38:08.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51405 req_id = b647f03b-78aa-487d-ab11-e193c28c7033 response_code = 204 uri = /vpc-routes
31762024-11-01T22:38:08.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39000
31772024-11-01T22:38:08.993ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
31782024-11-01T22:38:08.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126193 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63608 req_id = 06a0af31-1b8a-4602-8986-ea954657c673 response_code = 204 uri = /switch-ports
31792024-11-01T22:38:08.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 751 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63608 req_id = 9f69c932-ed45-4fd3-8b51-4d182e9a0651 response_code = 200 uri = /network-bootstore-config
31802024-11-01T22:38:09.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58154
31812024-11-01T22:38:09.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58154 req_id = 87d64fe5-4e8d-42fd-a97b-389e79a810a3 response_code = 200 uri = /v2p
31822024-11-01T22:38:09.039ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
31832024-11-01T22:38:09.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131658 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39000 req_id = 2bafecf6-679d-4844-a567-18b61f0b18b5 response_code = 204 uri = /switch-ports
31842024-11-01T22:38:09.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39000 req_id = b2333d49-fa20-48c4-bede-099e88f20968 response_code = 200 uri = /network-bootstore-config
31852024-11-01T22:38:11.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31862024-11-01T22:38:11.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31872024-11-01T22:38:11.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31882024-11-01T22:38:11.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31892024-11-01T22:38:11.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31902024-11-01T22:38:11.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31912024-11-01T22:38:11.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31922024-11-01T22:38:11.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31932024-11-01T22:38:11.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31942024-11-01T22:38:11.955ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31952024-11-01T22:38:11.955ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31962024-11-01T22:38:11.956ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31972024-11-01T22:38:11.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31982024-11-01T22:38:11.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
31992024-11-01T22:38:11.958ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
32002024-11-01T22:38:11.963ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
32012024-11-01T22:38:11.974ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
32022024-11-01T22:38:11.975ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79