Max level shown:
1 [ Nov 1 06:49:02 Enabled. ]
2 [ Nov 1 06:49:02 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 1 06:49:02 Method "start" exited with status 0. ]
4 [ Nov 1 06:49:02 Rereading configuration. ]
5 [ Nov 1 06:49:02 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-01T06:49:02.492ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-01T06:49:02.493ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-01T06:49:02.543ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-01T06:49:02.543ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-01T06:49:02.657ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-01T06:49:02.666ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-01T06:49:02.674ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-01T06:49:03.278ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-01T06:49:03.414ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-01T06:49:03.414ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-01T06:49:03.414ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-01T06:49:03.414ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-01T06:49:03.414ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-11-01T06:49:03.414ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-11-01T06:49:03.417ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-01T06:49:03.417ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-01T06:49:03.417ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-01T06:49:03.417ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-01T06:49:03.417ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-01T06:49:03.417ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-01T06:49:03.417ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-11-01T06:49:03.417ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-01T06:49:03.417ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-01T06:49:03.428ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-01T06:49:03.428ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool)
322024-11-01T06:49:03.523ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal }
332024-11-01T06:49:03.977ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-11-01T06:49:03.978ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-01T06:49:03.978ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-01T06:49:03.978ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-01T06:49:03.978ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-11-01T06:49:03.978ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-01T06:49:03.978ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-01T06:49:03.985ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-01T06:49:03.986ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool)
422024-11-01T06:49:04.071ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal }
432024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
482024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
532024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
592024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
632024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
692024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
702024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
782024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
842024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
872024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-01T06:49:04.512ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
932024-11-01T06:49:04.512ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-01T06:49:04.512ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-01T06:49:04.512ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-01T06:49:04.512ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-01T06:49:04.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-01T06:49:04.512ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1032024-11-01T06:49:04.512ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-01T06:49:04.512ZINFOSledAgent (bootstore): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-01T06:49:04.512ZINFOSledAgent (bootstore): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-01T06:49:04.512ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-01T06:49:04.512ZINFOSledAgent (bootstore): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-01T06:49:04.512ZINFOSledAgent (bootstore): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-01T06:49:04.512ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-01T06:49:04.512ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-01T06:49:04.512ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-01T06:49:04.524ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1132024-11-01T06:49:04.524ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2588, tv_nsec: 743612642 } time_to_next_cleanup = 599.99994385s
1142024-11-01T06:49:04.524ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
1152024-11-01T06:49:04.524ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1162024-11-01T06:49:04.524ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-01T06:49:04.526ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-01T06:49:04.527ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-01T06:49:04.529ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-01T06:49:04.529ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1074
1212024-11-01T06:49:04.529ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-01T06:49:04.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-11-01T06:49:04.530ZINFOSledAgent (RSS): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-01T06:49:04.530ZINFOSledAgent (RSS): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-01T06:49:04.530ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1137
1262024-11-01T06:49:04.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-11-01T06:49:04.530ZINFOSledAgent (RSS): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-01T06:49:04.530ZINFOSledAgent (RSS): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-01T06:49:04.530ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1179
1302024-11-01T06:49:04.530ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-01T06:49:04.530ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-01T06:49:04.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-11-01T06:49:04.530ZINFOSledAgent (RSS): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-01T06:49:04.530ZINFOSledAgent (RSS): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-01T06:49:04.530ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: e3a0579d-db41-429a-a770-e6cab66d0ec4, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 66656a2e-362d-410c-b905-3979762845f4 (sled), rack_id: e3a0579d-db41-429a-a770-e6cab66d0ec4, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-01T06:49:04.530ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1213
1372024-11-01T06:49:04.530ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-01T06:49:04.530ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-01T06:49:04.531ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-01T06:49:04.531ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-01T06:49:04.531ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 66656a2e-362d-410c-b905-3979762845f4 (sled), rack_id: e3a0579d-db41-429a-a770-e6cab66d0ec4, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-01T06:49:04.531ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4206
1432024-11-01T06:49:04.531ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4588
1442024-11-01T06:49:04.536ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-01T06:49:04.542ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-01T06:49:04.542ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-01T06:49:04.547ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-01T06:49:04.547ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-01T06:49:04.547ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:52832
1502024-11-01T06:49:04.547ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 66656a2e-362d-410c-b905-3979762845f4 (sled), rack_id: e3a0579d-db41-429a-a770-e6cab66d0ec4, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-01T06:49:04.547ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-01T06:49:04.547ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-01T06:49:04.547ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1552024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1562024-11-01T06:49:04.547ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1602024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1612024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1622024-11-01T06:49:04.547ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-01T06:49:04.547ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1642024-11-01T06:49:04.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1652024-11-01T06:49:04.586ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-01T06:49:04.603ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-01T06:49:04.609ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 66656a2e-362d-410c-b905-3979762845f4
1682024-11-01T06:49:04.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1692024-11-01T06:49:04.609ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 66656a2e-362d-410c-b905-3979762845f4
1702024-11-01T06:49:04.609ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-01T06:49:04.612ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 149.241773ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e826d8e4-2726-4836-b7a1-f97d400ae243", "content-length": "124", "date": "Fri, 01 Nov 2024 06:49:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e826d8e4-2726-4836-b7a1-f97d400ae243" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-01T06:49:04.621ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_fc28d189-ac13-484c-bb99-0ea04c623f0c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-01T06:49:04.644ZINFOSledAgent: successfully created encrypted zvol: name="oxi_fc28d189-ac13-484c-bb99-0ea04c623f0c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-01T06:49:04.644ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_fc28d189-ac13-484c-bb99-0ea04c623f0c/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-01T06:49:04.649ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 66656a2e-362d-410c-b905-3979762845f4
1762024-11-01T06:49:04.649ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-01T06:49:04.649ZINFOSledAgent (BackingFs): Ensuring dataset oxi_fc28d189-ac13-484c-bb99-0ea04c623f0c/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-01T06:49:04.733ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792024-11-01T06:49:04.762ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-11-01T06:49:04.763ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 102.605321ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "62c51bbb-6fe9-40be-82b8-ad840b664a48", "content-length": "124", "date": "Fri, 01 Nov 2024 06:49:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "62c51bbb-6fe9-40be-82b8-ad840b664a48" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-11-01T06:49:04.867ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-01T06:49:04.867ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 118.679437ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "db67761e-8b3b-4242-85c6-c3f589b239be", "content-length": "124", "date": "Fri, 01 Nov 2024 06:49:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "db67761e-8b3b-4242-85c6-c3f589b239be" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-01T06:49:04.952ZINFOSledAgent (BackingFs): Mounting oxi_fc28d189-ac13-484c-bb99-0ea04c623f0c/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-01T06:49:04.965ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-01T06:49:04.965ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-01T06:49:04.965ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-01T06:49:04.965ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-01T06:49:04.988ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-01T06:49:04.989ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 257.415776ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5375e794-a5a9-42f8-a0d7-d1b01ac2e4df", "content-length": "124", "date": "Fri, 01 Nov 2024 06:49:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5375e794-a5a9-42f8-a0d7-d1b01ac2e4df" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-01T06:49:05.248ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-01T06:49:05.249ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 105.769402ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a8c30a35-61ed-42a7-a997-e70b2b4b1525", "content-length": "124", "date": "Fri, 01 Nov 2024 06:49:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a8c30a35-61ed-42a7-a997-e70b2b4b1525" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-01T06:49:05.356ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-01T06:49:05.356ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 149.656176ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1a641a39-bfac-45b9-8f92-73a0691d958c", "content-length": "124", "date": "Fri, 01 Nov 2024 06:49:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1a641a39-bfac-45b9-8f92-73a0691d958c" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-01T06:49:05.507ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-01T06:49:05.508ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 414.87112ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e4882819-9dad-45b8-95b9-cd16a3425766", "content-length": "124", "date": "Fri, 01 Nov 2024 06:49:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e4882819-9dad-45b8-95b9-cd16a3425766" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-01T06:49:05.695ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 66656a2e-362d-410c-b905-3979762845f4
1972024-11-01T06:49:05.701ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:65472 sled_id = 66656a2e-362d-410c-b905-3979762845f4
1982024-11-01T06:49:05.701ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 66656a2e-362d-410c-b905-3979762845f4
1992024-11-01T06:49:05.701ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:65472 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 66656a2e-362d-410c-b905-3979762845f4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2002024-11-01T06:49:05.702ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 247.931602ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2012024-11-01T06:49:05.703ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2022024-11-01T06:49:05.703ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2032024-11-01T06:49:05.703ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2042024-11-01T06:49:05.703ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-01T06:49:05.923ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-01T06:49:05.952ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 490.579541ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2072024-11-01T06:49:06.444ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.225021568s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2082024-11-01T06:49:07.671ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.44956665s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2092024-11-01T06:49:08.183ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2102024-11-01T06:49:08.184ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2112024-11-01T06:49:08.184ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2122024-11-01T06:49:08.184ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2132024-11-01T06:49:08.184ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2142024-11-01T06:49:08.184ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2152024-11-01T06:49:08.186ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2162024-11-01T06:49:08.187ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2172024-11-01T06:49:08.187ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='c41cd609-3875-4f9c-b30a-14fd98554158'/> <propval type="astring" name="rack_id" value='e3a0579d-db41-429a-a770-e6cab66d0ec4'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe80:eb2a'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='66656a2e-362d-410c-b905-3979762845f4'/> <propval type="astring" name="rack_id" value='e3a0579d-db41-429a-a770-e6cab66d0ec4'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='66656a2e-362d-410c-b905-3979762845f4'/> <propval type="astring" name="rack_uuid" value='e3a0579d-db41-429a-a770-e6cab66d0ec4'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='66656a2e-362d-410c-b905-3979762845f4'/> <propval type="astring" name="rack_uuid" value='e3a0579d-db41-429a-a770-e6cab66d0ec4'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-01T06:49:08.187ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-01T06:49:08.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 62.571782ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-01T06:49:08.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 130.550002ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-01T06:49:08.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 131.081258ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-01T06:49:09.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 309.389784ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-01T06:49:09.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 638.794859ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-01T06:49:10.122ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.66952805s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2252024-11-01T06:49:10.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 649.084585ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-01T06:49:10.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 554.669716ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-01T06:49:11.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.370181622s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-01T06:49:13.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.116159373s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-01T06:49:14.631ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/66656a2e-362d-410c-b905-3979762845f4) file = sled-agent/src/nexus.rs:527 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2302024-11-01T06:49:14.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2312024-11-01T06:49:14.661ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2322024-11-01T06:49:14.662ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-01T06:49:14.662ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-01T06:49:14.662ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2352024-11-01T06:49:14.662ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-01T06:49:14.663ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-01T06:49:14.663ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-01T06:49:14.663ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2392024-11-01T06:49:14.663ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:52832
2402024-11-01T06:49:14.663ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
2412024-11-01T06:49:14.839ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-11-01T06:49:14.839ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-11-01T06:49:14.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2442024-11-01T06:49:14.839ZINFOSledAgent (RSS): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-01T06:49:14.839ZINFOSledAgent (RSS): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-01T06:49:14.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-11-01T06:49:14.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-11-01T06:49:14.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2492024-11-01T06:49:14.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2502024-11-01T06:49:14.844ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4230 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-01T06:49:14.844ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4246
2522024-11-01T06:49:14.844ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-01T06:49:15.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63019
2542024-11-01T06:49:15.114ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2552024-11-01T06:49:15.114ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2562024-11-01T06:49:15.114ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-01T06:49:15.114ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-01T06:49:15.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63019 req_id = 029ff611-96a8-4841-889e-eaef26f3555c response_code = 200 uri = /inventory
2592024-11-01T06:49:15.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50035
2602024-11-01T06:49:15.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50035 req_id = 17a14734-4631-4fc2-b04b-4988a7c05a27 response_code = 200 uri = /sled-role
2612024-11-01T06:49:15.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2622024-11-01T06:49:15.144ZINFOSledAgent (RSS): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-01T06:49:15.144ZINFOSledAgent (RSS): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-01T06:49:15.145ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2652024-11-01T06:49:15.176ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 661f637b-dc4e-498a-af01-91f527feee24, pool_id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 35dd133a-22d7-431f-93fe-1246fc4b9738, pool_id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 1a3e5bc8-28cf-46ce-8a3a-052c2d8cb5e0, pool_id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: acc3dcea-fb2d-4440-82fe-13884dfc426c, pool_id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 9bb92203-4c5d-4011-8300-55dd1ad14c18, pool_id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 81cd0728-891d-4edd-8409-9481454b802e, pool_id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: feae3d9f-ea1d-4020-90cd-d502b167b9ff, pool_id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: fab616e3-12af-42ba-9951-f3daf86ee1c0, pool_id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: d31a0148-bd30-4d20-99a4-b5c91f2e83cf, pool_id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-01T06:49:15.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50417
2672024-11-01T06:49:15.177ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:886 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2682024-11-01T06:49:15.177ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 661f637b-dc4e-498a-af01-91f527feee24, pool_id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 35dd133a-22d7-431f-93fe-1246fc4b9738, pool_id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 1a3e5bc8-28cf-46ce-8a3a-052c2d8cb5e0, pool_id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: acc3dcea-fb2d-4440-82fe-13884dfc426c, pool_id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 9bb92203-4c5d-4011-8300-55dd1ad14c18, pool_id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 81cd0728-891d-4edd-8409-9481454b802e, pool_id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: feae3d9f-ea1d-4020-90cd-d502b167b9ff, pool_id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: fab616e3-12af-42ba-9951-f3daf86ee1c0, pool_id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: d31a0148-bd30-4d20-99a4-b5c91f2e83cf, pool_id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2692024-11-01T06:49:15.177ZINFOSledAgent (StorageManager): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-01T06:49:15.177ZINFOSledAgent (StorageManager): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-01T06:49:15.177ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2722024-11-01T06:49:15.177ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-01T06:49:15.177ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-01T06:49:15.177ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-01T06:49:15.177ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-01T06:49:15.303ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-11-01T06:49:15.303ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool)
2782024-11-01T06:49:15.735ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11464784626165255272 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2792024-11-01T06:49:15.735ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3309048767737167508 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2802024-11-01T06:49:15.735ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/66656a2e-362d-410c-b905-3979762845f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2812024-11-01T06:49:15.931ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2822024-11-01T06:49:15.936ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.431231602s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 66656a2e-362d-410c-b905-3979762845f4
2832024-11-01T06:49:15.981ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }
2842024-11-01T06:49:15.989ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:225
2852024-11-01T06:49:15.989ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:227
2862024-11-01T06:49:15.989ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2872024-11-01T06:49:15.989ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:233
2882024-11-01T06:49:15.989ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-01T06:49:15.989ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2902024-11-01T06:49:15.989ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
2912024-11-01T06:49:16.023ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-11-01T06:49:16.031ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dd270633-6bc2-4925-9cc8-0d8cbe344d5c/crypt/zone file = sled-storage/src/dataset.rs:288
2932024-11-01T06:49:16.199ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dd270633-6bc2-4925-9cc8-0d8cbe344d5c file = sled-storage/src/dataset.rs:374
2942024-11-01T06:49:16.207ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2952024-11-01T06:49:16.207ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2962024-11-01T06:49:16.207ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2972024-11-01T06:49:16.207ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2982024-11-01T06:49:16.207ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2992024-11-01T06:49:16.217ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3002024-11-01T06:49:16.217ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool)
3012024-11-01T06:49:16.311ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }
3022024-11-01T06:49:16.318ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:225
3032024-11-01T06:49:16.318ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:227
3042024-11-01T06:49:16.318ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
3052024-11-01T06:49:16.318ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:233
3062024-11-01T06:49:16.319ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-01T06:49:16.319ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-11-01T06:49:16.319ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3092024-11-01T06:49:16.353ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-01T06:49:16.361ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9c422399-4aa1-4979-b10e-d7bb51cc9ea8/crypt/zone file = sled-storage/src/dataset.rs:288
3112024-11-01T06:49:16.535ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9c422399-4aa1-4979-b10e-d7bb51cc9ea8 file = sled-storage/src/dataset.rs:374
3122024-11-01T06:49:16.543ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-01T06:49:16.543ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-01T06:49:16.543ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-01T06:49:16.543ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-01T06:49:16.543ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-01T06:49:16.552ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-01T06:49:16.552ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ef152924-a63c-43bb-a571-2ff3b6071747 (zpool)
3192024-11-01T06:49:16.648ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }
3202024-11-01T06:49:16.656ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:225
3212024-11-01T06:49:16.656ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:227
3222024-11-01T06:49:16.656ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3232024-11-01T06:49:16.656ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:233
3242024-11-01T06:49:16.656ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-01T06:49:16.657ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-01T06:49:16.657ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3272024-11-01T06:49:16.691ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-01T06:49:16.699ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ef152924-a63c-43bb-a571-2ff3b6071747/crypt/zone file = sled-storage/src/dataset.rs:288
3292024-11-01T06:49:16.741ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/66656a2e-362d-410c-b905-3979762845f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 66656a2e-362d-410c-b905-3979762845f4
3302024-11-01T06:49:16.874ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ef152924-a63c-43bb-a571-2ff3b6071747 file = sled-storage/src/dataset.rs:374
3312024-11-01T06:49:16.882ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3322024-11-01T06:49:16.882ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3332024-11-01T06:49:16.882ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3342024-11-01T06:49:16.882ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3352024-11-01T06:49:16.882ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3362024-11-01T06:49:16.892ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3372024-11-01T06:49:16.892ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool)
3382024-11-01T06:49:16.987ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }
3392024-11-01T06:49:16.995ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:225
3402024-11-01T06:49:16.995ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:227
3412024-11-01T06:49:16.995ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3422024-11-01T06:49:16.995ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:233
3432024-11-01T06:49:16.995ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-01T06:49:16.995ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3452024-11-01T06:49:16.995ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3462024-11-01T06:49:17.029ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3472024-11-01T06:49:17.037ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_97f3e142-6bfb-426e-92d5-9fe2f0689aa2/crypt/zone file = sled-storage/src/dataset.rs:288
3482024-11-01T06:49:17.219ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_97f3e142-6bfb-426e-92d5-9fe2f0689aa2 file = sled-storage/src/dataset.rs:374
3492024-11-01T06:49:17.226ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3502024-11-01T06:49:17.226ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3512024-11-01T06:49:17.226ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3522024-11-01T06:49:17.226ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3532024-11-01T06:49:17.226ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3542024-11-01T06:49:17.236ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3552024-11-01T06:49:17.236ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool)
3562024-11-01T06:49:17.338ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }
3572024-11-01T06:49:17.346ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:225
3582024-11-01T06:49:17.346ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:227
3592024-11-01T06:49:17.346ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3602024-11-01T06:49:17.346ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:233
3612024-11-01T06:49:17.346ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-01T06:49:17.346ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-11-01T06:49:17.346ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3642024-11-01T06:49:17.382ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-01T06:49:17.390ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fd147d75-70ba-4f51-bd1a-94ba187fecc6/crypt/zone file = sled-storage/src/dataset.rs:288
3662024-11-01T06:49:17.565ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fd147d75-70ba-4f51-bd1a-94ba187fecc6 file = sled-storage/src/dataset.rs:374
3672024-11-01T06:49:17.573ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-01T06:49:17.573ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-01T06:49:17.573ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-01T06:49:17.573ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-01T06:49:17.573ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-01T06:49:17.582ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-01T06:49:17.582ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool)
3742024-11-01T06:49:17.680ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool), kind: External }
3752024-11-01T06:49:17.687ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:225
3762024-11-01T06:49:17.687ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:227
3772024-11-01T06:49:17.687ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3782024-11-01T06:49:17.687ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:233
3792024-11-01T06:49:17.687ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-01T06:49:17.688ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-01T06:49:17.688ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3822024-11-01T06:49:17.723ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-01T06:49:17.731ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d3002782-e4e6-4eb6-90d0-05203f9776aa/crypt/zone file = sled-storage/src/dataset.rs:288
3842024-11-01T06:49:17.744ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/66656a2e-362d-410c-b905-3979762845f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 66656a2e-362d-410c-b905-3979762845f4
3852024-11-01T06:49:17.906ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d3002782-e4e6-4eb6-90d0-05203f9776aa file = sled-storage/src/dataset.rs:374
3862024-11-01T06:49:17.914ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3872024-11-01T06:49:17.914ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3882024-11-01T06:49:17.914ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3892024-11-01T06:49:17.914ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3902024-11-01T06:49:17.914ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3912024-11-01T06:49:17.926ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3922024-11-01T06:49:17.926ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool)
3932024-11-01T06:49:18.023ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool), kind: External }
3942024-11-01T06:49:18.031ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:225
3952024-11-01T06:49:18.032ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:227
3962024-11-01T06:49:18.032ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
3972024-11-01T06:49:18.032ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:233
3982024-11-01T06:49:18.032ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-01T06:49:18.032ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4002024-11-01T06:49:18.032ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4012024-11-01T06:49:18.068ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022024-11-01T06:49:18.076ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e1a43d6a-09dc-44d6-9940-8b3aa07b0871/crypt/zone file = sled-storage/src/dataset.rs:288
4032024-11-01T06:49:18.251ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e1a43d6a-09dc-44d6-9940-8b3aa07b0871 file = sled-storage/src/dataset.rs:374
4042024-11-01T06:49:18.259ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-01T06:49:18.259ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-01T06:49:18.259ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-01T06:49:18.259ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-01T06:49:18.259ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-01T06:49:18.268ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-01T06:49:18.268ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool)
4112024-11-01T06:49:18.360ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool), kind: External }
4122024-11-01T06:49:18.368ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:225
4132024-11-01T06:49:18.368ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:227
4142024-11-01T06:49:18.368ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4152024-11-01T06:49:18.368ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:233
4162024-11-01T06:49:18.368ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-01T06:49:18.368ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-01T06:49:18.368ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4192024-11-01T06:49:18.404ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-01T06:49:18.411ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_415a68a1-91bd-446b-a587-2b70d19e26e9/crypt/zone file = sled-storage/src/dataset.rs:288
4212024-11-01T06:49:18.589ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_415a68a1-91bd-446b-a587-2b70d19e26e9 file = sled-storage/src/dataset.rs:374
4222024-11-01T06:49:18.598ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-01T06:49:18.598ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-01T06:49:18.598ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-01T06:49:18.598ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-01T06:49:18.598ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-01T06:49:18.607ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-01T06:49:18.607ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool)
4292024-11-01T06:49:18.706ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool), kind: External }
4302024-11-01T06:49:18.714ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:225
4312024-11-01T06:49:18.714ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:227
4322024-11-01T06:49:18.714ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4332024-11-01T06:49:18.714ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:233
4342024-11-01T06:49:18.714ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-01T06:49:18.715ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-01T06:49:18.715ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4372024-11-01T06:49:18.749ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/66656a2e-362d-410c-b905-3979762845f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 66656a2e-362d-410c-b905-3979762845f4
4382024-11-01T06:49:18.751ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4392024-11-01T06:49:18.758ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_950a040d-5cd2-426c-8ac9-53395920b1aa/crypt/zone file = sled-storage/src/dataset.rs:288
4402024-11-01T06:49:18.932ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_950a040d-5cd2-426c-8ac9-53395920b1aa file = sled-storage/src/dataset.rs:374
4412024-11-01T06:49:18.940ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4422024-11-01T06:49:18.940ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4432024-11-01T06:49:18.940ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4442024-11-01T06:49:18.940ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc28d189-ac13-484c-bb99-0ea04c623f0c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5d27312-460e-427e-9a8a-bfde3f16d714 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4452024-11-01T06:49:18.940ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4462024-11-01T06:49:18.940ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4472024-11-01T06:49:18.940ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4482024-11-01T06:49:18.940ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:890 sled_id = 66656a2e-362d-410c-b905-3979762845f4
4492024-11-01T06:49:18.940ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4502024-11-01T06:49:18.940ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:916 generation = Generation(1) sled_id = 66656a2e-362d-410c-b905-3979762845f4
4512024-11-01T06:49:18.940ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:921 sled_id = 66656a2e-362d-410c-b905-3979762845f4
4522024-11-01T06:49:18.940ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:926 sled_id = 66656a2e-362d-410c-b905-3979762845f4
4532024-11-01T06:49:18.940ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 66656a2e-362d-410c-b905-3979762845f4
4542024-11-01T06:49:18.940ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:932 sled_id = 66656a2e-362d-410c-b905-3979762845f4
4552024-11-01T06:49:18.940ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4562024-11-01T06:49:18.940ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:937 sled_id = 66656a2e-362d-410c-b905-3979762845f4
4572024-11-01T06:49:18.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3764166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50417 req_id = 3fe7b847-5597-4659-a1bd-3cbbf04b034e response_code = 200 uri = /omicron-physical-disks
4582024-11-01T06:49:18.972ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: d9f416a5-804e-4a22-b553-2d37c4537b13 (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 04da823b-9962-4b32-a9cf-0c956438d509 (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e383fdc4-4a2d-4a59-9b3e-eb64280698de (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4592024-11-01T06:49:18.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36916
4602024-11-01T06:49:18.973ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4612024-11-01T06:49:18.973ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }
4622024-11-01T06:49:19.026ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4632024-11-01T06:49:19.026ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4642024-11-01T06:49:19.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4652024-11-01T06:49:19.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4662024-11-01T06:49:19.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4672024-11-01T06:49:19.129ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:188
4682024-11-01T06:49:19.129ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:188
4692024-11-01T06:49:19.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4702024-11-01T06:49:19.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4712024-11-01T06:49:19.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4722024-11-01T06:49:19.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4732024-11-01T06:49:19.226ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de file = illumos-utils/src/zone.rs:325
4742024-11-01T06:49:19.230ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13 file = illumos-utils/src/zone.rs:325
4752024-11-01T06:49:19.234ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509 file = illumos-utils/src/zone.rs:325
4762024-11-01T06:49:19.246ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de file = illumos-utils/src/zone.rs:363
4772024-11-01T06:49:19.251ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13 file = illumos-utils/src/zone.rs:363
4782024-11-01T06:49:19.255ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509 file = illumos-utils/src/zone.rs:363
4792024-11-01T06:49:19.751ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/66656a2e-362d-410c-b905-3979762845f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 66656a2e-362d-410c-b905-3979762845f4
4802024-11-01T06:49:20.814ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4812024-11-01T06:49:20.814ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4822024-11-01T06:49:20.814ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
4832024-11-01T06:49:21.298ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4842024-11-01T06:49:21.298ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4852024-11-01T06:49:21.779ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4862024-11-01T06:49:21.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 64.093422ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
4872024-11-01T06:49:21.786ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
4882024-11-01T06:49:21.790ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4892024-11-01T06:49:21.790ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
4902024-11-01T06:49:21.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 79.256819ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
4912024-11-01T06:49:21.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 50.221035ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
4922024-11-01T06:49:21.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 43.169714ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
4932024-11-01T06:49:21.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 191.084708ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
4942024-11-01T06:49:21.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 77.018147ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
4952024-11-01T06:49:22.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 107.948797ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
4962024-11-01T06:49:22.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 283.108163ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
4972024-11-01T06:49:22.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 355.163221ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
4982024-11-01T06:49:22.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 174.565272ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
4992024-11-01T06:49:22.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 351.187362ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
5002024-11-01T06:49:22.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 517.12924ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
5012024-11-01T06:49:22.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 1.140271874s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
5022024-11-01T06:49:22.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 572.887137ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
5032024-11-01T06:49:23.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 449.720749ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
5042024-11-01T06:49:23.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 1.031842953s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
5052024-11-01T06:49:23.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 956.543151ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
5062024-11-01T06:49:23.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 1.202705882s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
5072024-11-01T06:49:24.464ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4254
5082024-11-01T06:49:24.464ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4264 gateway = fd00:1122:3344:101::1
5092024-11-01T06:49:24.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 962.19862ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
5102024-11-01T06:49:24.470ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4343
5112024-11-01T06:49:24.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 1.274644617s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
5122024-11-01T06:49:24.573ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4391
5132024-11-01T06:49:24.574ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4418
5142024-11-01T06:49:24.612ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4431
5152024-11-01T06:49:24.612ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4295
5162024-11-01T06:49:24.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3107116864590034719 sled_id = 66656a2e-362d-410c-b905-3979762845f4
5172024-11-01T06:49:24.636ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3947008137351296812 sled_id = 66656a2e-362d-410c-b905-3979762845f4
5182024-11-01T06:49:24.662ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4337
5192024-11-01T06:49:24.662ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4398 rack_subnet = fd00:1122:3344::
5202024-11-01T06:49:24.680ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4409
5212024-11-01T06:49:24.680ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4451
5222024-11-01T06:49:24.747ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4483
5232024-11-01T06:49:24.747ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4489
5242024-11-01T06:49:24.832ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4530
5252024-11-01T06:49:24.832ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5262024-11-01T06:49:24.864ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 32.295433ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5272024-11-01T06:49:24.897ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 75.798477ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5282024-11-01T06:49:24.975ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5292024-11-01T06:49:25.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 1.277353236s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
5302024-11-01T06:49:25.011ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5312024-11-01T06:49:25.012ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:724
5322024-11-01T06:49:25.012ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:727 uptime = 1
5332024-11-01T06:49:25.012ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5342024-11-01T06:49:25.049ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
5352024-11-01T06:49:25.097ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5362024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5372024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5382024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5392024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5402024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5412024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5422024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5432024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5442024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5452024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5462024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5472024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5482024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5492024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5502024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5512024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5522024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5532024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5542024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5552024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5562024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5572024-11-01T06:49:25.097ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5582024-11-01T06:49:25.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:50240
5592024-11-01T06:49:25.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:50240 req_id = fb7009dd-2bdc-42b5-9701-ab9ce0efe017 response_code = 200 uri = /sled-identifiers
5602024-11-01T06:49:25.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 768.501137ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
5612024-11-01T06:49:25.738ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11464784626165255272 sled_id = 66656a2e-362d-410c-b905-3979762845f4
5622024-11-01T06:49:25.738ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3309048767737167508 sled_id = 66656a2e-362d-410c-b905-3979762845f4
5632024-11-01T06:49:25.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 915.510972ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
5642024-11-01T06:49:26.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509") failed: Property not found. retry in 871.071343ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
5652024-11-01T06:49:26.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13") failed: Property not found. retry in 746.993111ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
5662024-11-01T06:49:26.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de") failed: Property not found. retry in 984.261773ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
5672024-11-01T06:49:27.714ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_e383fdc4-4a2d-4a59-9b3e-eb64280698de
5682024-11-01T06:49:27.714ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_d9f416a5-804e-4a22-b553-2d37c4537b13
5692024-11-01T06:49:27.714ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_04da823b-9962-4b32-a9cf-0c956438d509
5702024-11-01T06:49:27.714ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5712024-11-01T06:49:27.714ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5722024-11-01T06:49:27.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8742399 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36916 req_id = 904f3c5a-c67a-4086-b57e-158d1bfe1356 response_code = 204 uri = /omicron-zones
5732024-11-01T06:49:27.717ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5742024-11-01T06:49:27.768ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5752024-11-01T06:49:27.815ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5762024-11-01T06:49:27.863ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5772024-11-01T06:49:27.863ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5782024-11-01T06:49:27.893ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5792024-11-01T06:49:27.894ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5802024-11-01T06:49:27.894ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5812024-11-01T06:49:27.923ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: d9f416a5-804e-4a22-b553-2d37c4537b13 (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 04da823b-9962-4b32-a9cf-0c956438d509 (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e383fdc4-4a2d-4a59-9b3e-eb64280698de (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2ecd8e65-03e6-4948-a200-fa0d03ce15d2 (service), filesystem_pool: Some(ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c2f9eb8f-d881-46e0-a2c8-a4873da21c3e, kind: Service { id: 2ecd8e65-03e6-4948-a200-fa0d03ce15d2 }, name: Name("ntp-2ecd8e65-03e6-4948-a200-fa0d03ce15d2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 2])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5822024-11-01T06:49:27.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49625
5832024-11-01T06:49:27.923ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5842024-11-01T06:49:27.923ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }
5852024-11-01T06:49:27.943ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5862024-11-01T06:49:27.943ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5872024-11-01T06:49:27.960ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5882024-11-01T06:49:27.960ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5892024-11-01T06:49:27.978ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5902024-11-01T06:49:27.978ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
5912024-11-01T06:49:27.978ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
5922024-11-01T06:49:27.978ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5932024-11-01T06:49:27.990ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5942024-11-01T06:49:28.022ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5952024-11-01T06:49:28.023ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5962024-11-01T06:49:28.023ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5972024-11-01T06:49:28.052ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 239, 2]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5982024-11-01T06:49:28.052ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
5992024-11-01T06:49:28.052ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
6002024-11-01T06:49:28.052ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
6012024-11-01T06:49:28.052ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
6022024-11-01T06:49:28.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6032024-11-01T06:49:28.077ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2 file = illumos-utils/src/zone.rs:325
6042024-11-01T06:49:28.095ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2 file = illumos-utils/src/zone.rs:363
6052024-11-01T06:49:28.722ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6062024-11-01T06:49:28.723ZINFOSledAgent (ServiceManager): Booting oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6072024-11-01T06:49:28.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 34.637349ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6082024-11-01T06:49:28.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 78.353999ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6092024-11-01T06:49:28.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 154.760433ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6102024-11-01T06:49:29.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 235.314607ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6112024-11-01T06:49:29.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 828.002198ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6122024-11-01T06:49:30.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 1.070283772s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6132024-11-01T06:49:31.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 1.406613021s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6142024-11-01T06:49:32.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2") failed: Property not found. retry in 1.418715513s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6152024-11-01T06:49:34.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2
6162024-11-01T06:49:34.175ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6172024-11-01T06:49:34.175ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6182024-11-01T06:49:34.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6253119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49625 req_id = 5383fad2-6546-47b2-9a83-ea188c9c3002 response_code = 204 uri = /omicron-zones
6192024-11-01T06:49:34.178ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6202024-11-01T06:49:34.208ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6212024-11-01T06:49:34.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64430
6222024-11-01T06:49:34.217ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6232024-11-01T06:49:34.217ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8603 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64430 req_id = 23c21e25-b483-4c8f-a562-c768c560040f response_code = 500 uri = /timesync
6242024-11-01T06:49:34.220ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6252024-11-01T06:49:34.315ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6262024-11-01T06:49:34.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50187
6272024-11-01T06:49:34.638ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3107116864590034719 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6282024-11-01T06:49:34.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3947008137351296812 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6292024-11-01T06:49:35.741ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11464784626165255272 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6302024-11-01T06:49:35.741ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3309048767737167508 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6312024-11-01T06:49:37.068ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3486798079624044113 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6322024-11-01T06:49:37.111ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9341907758443574925 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6332024-11-01T06:49:37.717ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6037827994617923585 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6342024-11-01T06:49:38.324ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6352024-11-01T06:49:38.324ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008736 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50187 req_id = f37dd0b1-265d-45f5-b327-810178e34aed response_code = 500 uri = /timesync
6362024-11-01T06:49:38.327ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6372024-11-01T06:49:38.455ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6382024-11-01T06:49:38.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57825
6392024-11-01T06:49:38.463ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6402024-11-01T06:49:38.463ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8700 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57825 req_id = 02dfbf01-86e6-4f0c-9aae-e33835cb6c95 response_code = 500 uri = /timesync
6412024-11-01T06:49:38.466ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6422024-11-01T06:49:38.602ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6432024-11-01T06:49:38.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42879
6442024-11-01T06:49:43.086ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2ecd8e65-03e6-4948-a200-fa0d03ce15d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6452024-11-01T06:49:43.086ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42879 req_id = 2a11ace5-5a72-4c1b-85fe-fb76120ada5c response_code = 500 uri = /timesync
6462024-11-01T06:49:43.088ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6472024-11-01T06:49:43.349ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6482024-11-01T06:49:43.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43596
6492024-11-01T06:49:43.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9024 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43596 req_id = fbe60c79-3453-445b-b652-d64a5be9dcee response_code = 200 uri = /timesync
6502024-11-01T06:49:43.362ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6512024-11-01T06:49:43.362ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6522024-11-01T06:49:43.629ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6532024-11-01T06:49:43.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58903
6542024-11-01T06:49:43.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58903 req_id = 616d1d0b-2f17-4c26-a31f-da4175f43bf0 response_code = 200 uri = /timesync
6552024-11-01T06:49:43.639ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6562024-11-01T06:49:43.639ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6572024-11-01T06:49:43.872ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6582024-11-01T06:49:43.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42332
6592024-11-01T06:49:43.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42332 req_id = ef45f556-39e2-46b9-93f8-c7ecb7eccaca response_code = 200 uri = /timesync
6602024-11-01T06:49:43.883ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6612024-11-01T06:49:43.883ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6622024-11-01T06:49:44.077ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6632024-11-01T06:49:44.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51166
6642024-11-01T06:49:44.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8593 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51166 req_id = 3662f5f5-cd16-433d-8791-bfbafb029308 response_code = 200 uri = /timesync
6652024-11-01T06:49:44.089ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.014833539 } file = sled-agent/src/rack_setup/service.rs:661
6662024-11-01T06:49:44.089ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6672024-11-01T06:49:44.575ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6682024-11-01T06:49:44.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33464
6692024-11-01T06:49:44.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8545 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33464 req_id = b67ef118-cf1c-4af8-9b05-58b47cb5a253 response_code = 200 uri = /timesync
6702024-11-01T06:49:44.586ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.013480377 } file = sled-agent/src/rack_setup/service.rs:661
6712024-11-01T06:49:44.586ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6722024-11-01T06:49:44.652ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1681484096459796667 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6732024-11-01T06:49:44.652ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15246668048719573526 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6742024-11-01T06:49:45.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3107116864590034719 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6752024-11-01T06:49:45.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3947008137351296812 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6762024-11-01T06:49:45.246ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6772024-11-01T06:49:45.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38223
6782024-11-01T06:49:45.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8054 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38223 req_id = e1d7bf35-6b2e-47d1-a21f-d657072c46c2 response_code = 200 uri = /timesync
6792024-11-01T06:49:45.256ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.005817646 } file = sled-agent/src/rack_setup/service.rs:661
6802024-11-01T06:49:45.256ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6812024-11-01T06:49:45.897ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6822024-11-01T06:49:45.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63245
6832024-11-01T06:49:45.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8555 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63245 req_id = d609b28e-cb3e-4808-9e27-a14669623050 response_code = 200 uri = /timesync
6842024-11-01T06:49:45.909ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.005418804 } file = sled-agent/src/rack_setup/service.rs:661
6852024-11-01T06:49:45.909ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6862024-11-01T06:49:46.216ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11464784626165255272 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6872024-11-01T06:49:46.216ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3309048767737167508 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6882024-11-01T06:49:46.606ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6892024-11-01T06:49:46.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45185
6902024-11-01T06:49:46.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45185 req_id = 882853ba-e725-4540-a208-c7ff0b48b702 response_code = 200 uri = /timesync
6912024-11-01T06:49:46.617ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.017183049 } file = sled-agent/src/rack_setup/service.rs:661
6922024-11-01T06:49:46.617ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6932024-11-01T06:49:46.876ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 285.700168ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6942024-11-01T06:49:47.539ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3486798079624044113 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6952024-11-01T06:49:47.580ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9341907758443574925 sled_id = 66656a2e-362d-410c-b905-3979762845f4
6962024-11-01T06:49:47.685ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6972024-11-01T06:49:47.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49370
6982024-11-01T06:49:47.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49370 req_id = a15097f6-6b64-4b19-939e-3325ddcdfe3b response_code = 200 uri = /timesync
6992024-11-01T06:49:47.696ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.015678676 } file = sled-agent/src/rack_setup/service.rs:661
7002024-11-01T06:49:47.696ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7012024-11-01T06:49:48.187ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6037827994617923585 sled_id = 66656a2e-362d-410c-b905-3979762845f4
7022024-11-01T06:49:49.027ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7032024-11-01T06:49:49.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52538
7042024-11-01T06:49:49.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 21613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52538 req_id = 03f7a75d-6d8c-4828-8164-0062ab0579bd response_code = 200 uri = /timesync
7052024-11-01T06:49:49.053ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2732330510, ip_addr: 162.220.14.14, stratum: 5, ref_time: 1730443787.1998224, correction: -0.012509068 } file = sled-agent/src/rack_setup/service.rs:661
7062024-11-01T06:49:49.053ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1299
7072024-11-01T06:49:49.082ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: d9f416a5-804e-4a22-b553-2d37c4537b13 (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 04da823b-9962-4b32-a9cf-0c956438d509 (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e383fdc4-4a2d-4a59-9b3e-eb64280698de (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2ecd8e65-03e6-4948-a200-fa0d03ce15d2 (service), filesystem_pool: Some(ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c2f9eb8f-d881-46e0-a2c8-a4873da21c3e, kind: Service { id: 2ecd8e65-03e6-4948-a200-fa0d03ce15d2 }, name: Name("ntp-2ecd8e65-03e6-4948-a200-fa0d03ce15d2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 2])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d8975c3e-0650-458e-9cb7-244052117c4d (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } } } }, OmicronZoneConfig { id: 745e6cb2-f06e-4919-801a-a334b28aab5a (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } } } }, OmicronZoneConfig { id: eae11989-10c2-45b0-952b-a10afc263a6b (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5d7fc128-785d-4862-a76b-ce88a8eab380 (service), filesystem_pool: Some(ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0ab8422c-0634-47f9-97cf-001c3762949b (service), filesystem_pool: Some(ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
7082024-11-01T06:49:49.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45477
7092024-11-01T06:49:49.082ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7102024-11-01T06:49:49.082ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }
7112024-11-01T06:49:49.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7122024-11-01T06:49:49.103ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7132024-11-01T06:49:49.123ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7142024-11-01T06:49:49.123ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7152024-11-01T06:49:49.142ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d8975c3e-0650-458e-9cb7-244052117c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7162024-11-01T06:49:49.142ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d8975c3e-0650-458e-9cb7-244052117c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Cockroach }, responder: ... }
7172024-11-01T06:49:49.196ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 745e6cb2-f06e-4919-801a-a334b28aab5a, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7182024-11-01T06:49:49.196ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 745e6cb2-f06e-4919-801a-a334b28aab5a, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7192024-11-01T06:49:49.247ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eae11989-10c2-45b0-952b-a10afc263a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7202024-11-01T06:49:49.247ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: eae11989-10c2-45b0-952b-a10afc263a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7212024-11-01T06:49:49.298ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5d7fc128-785d-4862-a76b-ce88a8eab380, dataset_name: DatasetName { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7222024-11-01T06:49:49.298ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5d7fc128-785d-4862-a76b-ce88a8eab380, dataset_name: DatasetName { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7232024-11-01T06:49:49.353ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0ab8422c-0634-47f9-97cf-001c3762949b, dataset_name: DatasetName { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7242024-11-01T06:49:49.353ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 0ab8422c-0634-47f9-97cf-001c3762949b, dataset_name: DatasetName { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7252024-11-01T06:49:49.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7262024-11-01T06:49:49.405ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
7272024-11-01T06:49:49.405ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
7282024-11-01T06:49:49.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7292024-11-01T06:49:49.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7302024-11-01T06:49:49.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7312024-11-01T06:49:49.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7322024-11-01T06:49:49.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7332024-11-01T06:49:49.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7342024-11-01T06:49:49.580ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380 file = illumos-utils/src/zone.rs:325
7352024-11-01T06:49:49.584ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d file = illumos-utils/src/zone.rs:325
7362024-11-01T06:49:49.588ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b file = illumos-utils/src/zone.rs:325
7372024-11-01T06:49:49.592ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b file = illumos-utils/src/zone.rs:325
7382024-11-01T06:49:49.597ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a file = illumos-utils/src/zone.rs:325
7392024-11-01T06:49:49.602ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380 file = illumos-utils/src/zone.rs:363
7402024-11-01T06:49:49.606ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d file = illumos-utils/src/zone.rs:363
7412024-11-01T06:49:49.611ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b file = illumos-utils/src/zone.rs:363
7422024-11-01T06:49:49.616ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b file = illumos-utils/src/zone.rs:363
7432024-11-01T06:49:49.621ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a file = illumos-utils/src/zone.rs:363
7442024-11-01T06:49:52.451ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5d7fc128-785d-4862-a76b-ce88a8eab380'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7452024-11-01T06:49:52.452ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='745e6cb2-f06e-4919-801a-a334b28aab5a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7462024-11-01T06:49:52.452ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7472024-11-01T06:49:52.457ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7482024-11-01T06:49:52.484ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='eae11989-10c2-45b0-952b-a10afc263a6b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7492024-11-01T06:49:52.484ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7502024-11-01T06:49:52.567ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d8975c3e-0650-458e-9cb7-244052117c4d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7512024-11-01T06:49:52.567ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7522024-11-01T06:49:52.576ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0ab8422c-0634-47f9-97cf-001c3762949b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7532024-11-01T06:49:52.576ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7542024-11-01T06:49:52.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 25.815544ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7552024-11-01T06:49:52.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 71.050047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7562024-11-01T06:49:52.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 66.858494ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7572024-11-01T06:49:52.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 72.736003ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7582024-11-01T06:49:53.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 160.847838ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7592024-11-01T06:49:53.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 63.499459ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7602024-11-01T06:49:53.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 141.396042ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7612024-11-01T06:49:53.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 283.118903ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7622024-11-01T06:49:53.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 52.476431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7632024-11-01T06:49:54.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 294.957589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7642024-11-01T06:49:54.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 44.448341ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7652024-11-01T06:49:54.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 155.869414ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7662024-11-01T06:49:54.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 502.527794ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7672024-11-01T06:49:54.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 55.122099ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7682024-11-01T06:49:54.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 131.496465ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7692024-11-01T06:49:54.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 207.857271ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7702024-11-01T06:49:54.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 203.20803ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7712024-11-01T06:49:54.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 571.795513ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7722024-11-01T06:49:55.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 145.907774ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7732024-11-01T06:49:55.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 555.651934ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7742024-11-01T06:49:55.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 610.947047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7752024-11-01T06:49:55.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 329.248583ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7762024-11-01T06:49:55.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 1.450165464s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7772024-11-01T06:49:55.218ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51863
7782024-11-01T06:49:55.219ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 350 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51863 req_id = 070e8236-d441-4db8-ae97-9ddeef805eb7 response_code = 200 uri = /baseboard
7792024-11-01T06:49:55.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.17427417s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7802024-11-01T06:49:55.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 411.427385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7812024-11-01T06:49:55.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 960.750821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7822024-11-01T06:49:55.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 1.441256849s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7832024-11-01T06:49:55.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 976.489841ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7842024-11-01T06:49:56.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.097619358s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7852024-11-01T06:49:56.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 1.361905492s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7862024-11-01T06:49:56.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 604.09855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7872024-11-01T06:49:56.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 615.532709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7882024-11-01T06:49:57.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 905.994487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7892024-11-01T06:49:57.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 752.990451ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7902024-11-01T06:49:57.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 995.789683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7912024-11-01T06:49:57.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.046928461s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7922024-11-01T06:49:58.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 797.682415ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7932024-11-01T06:49:58.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 1.028045223s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7942024-11-01T06:49:58.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 1.14747922s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
7952024-11-01T06:49:58.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 693.287091ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
7962024-11-01T06:49:58.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.429973878s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
7972024-11-01T06:49:58.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 947.539342ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
7982024-11-01T06:49:59.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 957.238339ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
7992024-11-01T06:49:59.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 1.402105531s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8002024-11-01T06:49:59.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 957.522196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8012024-11-01T06:49:59.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 773.739483ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8022024-11-01T06:50:00.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 506.508197ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8032024-11-01T06:50:00.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.197737147s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8042024-11-01T06:50:00.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 1.486218765s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8052024-11-01T06:50:00.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 697.549532ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8062024-11-01T06:50:00.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 655.078376ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8072024-11-01T06:50:00.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 1.176168645s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8082024-11-01T06:50:01.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 695.878775ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8092024-11-01T06:50:01.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 1.291111773s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8102024-11-01T06:50:01.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.117377957s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8112024-11-01T06:50:01.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 555.584198ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8122024-11-01T06:50:01.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 579.316115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8132024-11-01T06:50:01.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 755.249024ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8142024-11-01T06:50:02.178ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 317.771816ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 66656a2e-362d-410c-b905-3979762845f4
8152024-11-01T06:50:02.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 1.111802319s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8162024-11-01T06:50:02.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 650.687977ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8172024-11-01T06:50:02.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 1.307538948s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8182024-11-01T06:50:02.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 569.267702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8192024-11-01T06:50:02.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 1.478025898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8202024-11-01T06:50:03.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 857.903096ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8212024-11-01T06:50:03.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.174433454s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8222024-11-01T06:50:03.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 1.03275828s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8232024-11-01T06:50:03.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 665.862143ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8242024-11-01T06:50:03.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 1.057163885s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8252024-11-01T06:50:04.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 802.547272ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8262024-11-01T06:50:04.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 596.212884ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8272024-11-01T06:50:04.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 1.32687147s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8282024-11-01T06:50:04.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 947.738057ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8292024-11-01T06:50:04.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 712.238796ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8302024-11-01T06:50:05.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 944.980904ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8312024-11-01T06:50:05.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 684.984761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8322024-11-01T06:50:05.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 993.23593ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8332024-11-01T06:50:05.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.134680042s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8342024-11-01T06:50:05.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 1.131939534s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8352024-11-01T06:50:05.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 909.10649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8362024-11-01T06:50:05.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 1.440961546s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8372024-11-01T06:50:06.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d") failed: Property not found. retry in 1.399689769s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8382024-11-01T06:50:06.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b") failed: Property not found. retry in 1.179648254s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8392024-11-01T06:50:06.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a") failed: Property not found. retry in 1.403192546s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8402024-11-01T06:50:06.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b") failed: Property not found. retry in 803.500291ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8412024-11-01T06:50:07.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380") failed: Property not found. retry in 1.339228714s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8422024-11-01T06:50:08.800ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_5d7fc128-785d-4862-a76b-ce88a8eab380
8432024-11-01T06:50:08.800ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_d8975c3e-0650-458e-9cb7-244052117c4d
8442024-11-01T06:50:08.800ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_eae11989-10c2-45b0-952b-a10afc263a6b
8452024-11-01T06:50:08.800ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_0ab8422c-0634-47f9-97cf-001c3762949b
8462024-11-01T06:50:08.800ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_745e6cb2-f06e-4919-801a-a334b28aab5a
8472024-11-01T06:50:08.800ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8482024-11-01T06:50:08.801ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8492024-11-01T06:50:08.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19731178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45477 req_id = b347bfa7-689f-4cae-a67f-1056d76cca13 response_code = 204 uri = /omicron-zones
8502024-11-01T06:50:08.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54109
8512024-11-01T06:50:08.863ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3705
8522024-11-01T06:50:17.805ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 979.737578ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 66656a2e-362d-410c-b905-3979762845f4
8532024-11-01T06:50:22.528ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3723
8542024-11-01T06:50:25.261ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52506
8552024-11-01T06:50:25.261ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52506 req_id = 72dc2626-2b3e-4d53-b0c0-5f40c70b5c8d response_code = 200 uri = /baseboard
8562024-11-01T06:50:33.632ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3746
8572024-11-01T06:50:33.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 24796318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:54109 req_id = c354a3b2-edda-4c13-a800-64b83fc14e06 response_code = 204 uri = /cockroachdb
8582024-11-01T06:50:33.670ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: d9f416a5-804e-4a22-b553-2d37c4537b13 (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 04da823b-9962-4b32-a9cf-0c956438d509 (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e383fdc4-4a2d-4a59-9b3e-eb64280698de (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2ecd8e65-03e6-4948-a200-fa0d03ce15d2 (service), filesystem_pool: Some(ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c2f9eb8f-d881-46e0-a2c8-a4873da21c3e, kind: Service { id: 2ecd8e65-03e6-4948-a200-fa0d03ce15d2 }, name: Name("ntp-2ecd8e65-03e6-4948-a200-fa0d03ce15d2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 2])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d8975c3e-0650-458e-9cb7-244052117c4d (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } } } }, OmicronZoneConfig { id: 745e6cb2-f06e-4919-801a-a334b28aab5a (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } } } }, OmicronZoneConfig { id: eae11989-10c2-45b0-952b-a10afc263a6b (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5d7fc128-785d-4862-a76b-ce88a8eab380 (service), filesystem_pool: Some(ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0ab8422c-0634-47f9-97cf-001c3762949b (service), filesystem_pool: Some(ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External } } } }, OmicronZoneConfig { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 (service), filesystem_pool: Some(ZpoolName { id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 (service), filesystem_pool: Some(ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 0327dabc-65b9-4ac6-91b2-e03c8243f5ef (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: d64435a0-4078-422f-a13c-9a7f6a3b6c68 (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } } } }, OmicronZoneConfig { id: db7e45a1-64f0-4cc1-9722-ad2c475ce26b (service), filesystem_pool: Some(ZpoolName { id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ed656401-1ee1-4946-94a6-1647da58448f (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: ab04a5dd-b232-4cb3-a748-cbf80211f85e (service), filesystem_pool: Some(ZpoolName { id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: e8e12190-7b9e-49c5-a57c-0696fecf22e2 (service), filesystem_pool: Some(ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External } } } }, OmicronZoneConfig { id: 9d86389c-d875-41a4-8ff1-cd71502d75af (service), filesystem_pool: Some(ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3a30bff9-17ec-4a3d-9028-d513ecc74934 (service), filesystem_pool: Some(ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External } } } }, OmicronZoneConfig { id: b216de2d-e219-4f4b-aea1-e5a389db1923 (service), filesystem_pool: Some(ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 26b05373-1d31-4bbe-996c-abec39e796af (service), filesystem_pool: Some(ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 57c7178e-0c1b-4716-9d43-77ca18e1ebbb (service), filesystem_pool: Some(ZpoolName { id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool), kind: External } } } }, OmicronZoneConfig { id: 51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37 (service), filesystem_pool: Some(ZpoolName { id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool), kind: External } } } }, OmicronZoneConfig { id: 02b6df60-f053-4321-822c-c553be09f97c (service), filesystem_pool: Some(ZpoolName { id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 071518ac-91f9-41a6-97f8-754edd29f2b3 (service), filesystem_pool: Some(ZpoolName { id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
8592024-11-01T06:50:33.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59218
8602024-11-01T06:50:33.671ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8612024-11-01T06:50:33.671ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d9f416a5-804e-4a22-b553-2d37c4537b13, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: InternalDns }, responder: ... }
8622024-11-01T06:50:33.696ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8632024-11-01T06:50:33.696ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 04da823b-9962-4b32-a9cf-0c956438d509, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8642024-11-01T06:50:33.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8652024-11-01T06:50:33.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e383fdc4-4a2d-4a59-9b3e-eb64280698de, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8662024-11-01T06:50:33.734ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d8975c3e-0650-458e-9cb7-244052117c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8672024-11-01T06:50:33.735ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d8975c3e-0650-458e-9cb7-244052117c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Cockroach }, responder: ... }
8682024-11-01T06:50:33.753ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 745e6cb2-f06e-4919-801a-a334b28aab5a, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8692024-11-01T06:50:33.753ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 745e6cb2-f06e-4919-801a-a334b28aab5a, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8702024-11-01T06:50:33.773ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eae11989-10c2-45b0-952b-a10afc263a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8712024-11-01T06:50:33.773ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: eae11989-10c2-45b0-952b-a10afc263a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8722024-11-01T06:50:33.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5d7fc128-785d-4862-a76b-ce88a8eab380, dataset_name: DatasetName { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8732024-11-01T06:50:33.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5d7fc128-785d-4862-a76b-ce88a8eab380, dataset_name: DatasetName { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8742024-11-01T06:50:33.813ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0ab8422c-0634-47f9-97cf-001c3762949b, dataset_name: DatasetName { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8752024-11-01T06:50:33.813ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 0ab8422c-0634-47f9-97cf-001c3762949b, dataset_name: DatasetName { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8762024-11-01T06:50:33.829ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.119911853s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 66656a2e-362d-410c-b905-3979762845f4
8772024-11-01T06:50:33.834ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8782024-11-01T06:50:33.834ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8792024-11-01T06:50:33.938ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: afcf56b3-6c52-4787-9733-ac81e42c29e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8802024-11-01T06:50:33.938ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: afcf56b3-6c52-4787-9733-ac81e42c29e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8812024-11-01T06:50:34.046ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d64435a0-4078-422f-a13c-9a7f6a3b6c68, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
8822024-11-01T06:50:34.046ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d64435a0-4078-422f-a13c-9a7f6a3b6c68, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8832024-11-01T06:50:34.166ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e8e12190-7b9e-49c5-a57c-0696fecf22e2, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8842024-11-01T06:50:34.166ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e8e12190-7b9e-49c5-a57c-0696fecf22e2, dataset_name: DatasetName { pool_name: ZpoolName { id: dd270633-6bc2-4925-9cc8-0d8cbe344d5c (zpool), kind: External }, kind: Crucible }, responder: ... }
8852024-11-01T06:50:34.276ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9d86389c-d875-41a4-8ff1-cd71502d75af, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8862024-11-01T06:50:34.276ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 9d86389c-d875-41a4-8ff1-cd71502d75af, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c422399-4aa1-4979-b10e-d7bb51cc9ea8 (zpool), kind: External }, kind: Crucible }, responder: ... }
8872024-11-01T06:50:34.397ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3a30bff9-17ec-4a3d-9028-d513ecc74934, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8882024-11-01T06:50:34.397ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3a30bff9-17ec-4a3d-9028-d513ecc74934, dataset_name: DatasetName { pool_name: ZpoolName { id: ef152924-a63c-43bb-a571-2ff3b6071747 (zpool), kind: External }, kind: Crucible }, responder: ... }
8892024-11-01T06:50:34.537ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b216de2d-e219-4f4b-aea1-e5a389db1923, dataset_name: DatasetName { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8902024-11-01T06:50:34.537ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: b216de2d-e219-4f4b-aea1-e5a389db1923, dataset_name: DatasetName { pool_name: ZpoolName { id: 97f3e142-6bfb-426e-92d5-9fe2f0689aa2 (zpool), kind: External }, kind: Crucible }, responder: ... }
8912024-11-01T06:50:34.640ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 26b05373-1d31-4bbe-996c-abec39e796af, dataset_name: DatasetName { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8922024-11-01T06:50:34.640ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 26b05373-1d31-4bbe-996c-abec39e796af, dataset_name: DatasetName { pool_name: ZpoolName { id: fd147d75-70ba-4f51-bd1a-94ba187fecc6 (zpool), kind: External }, kind: Crucible }, responder: ... }
8932024-11-01T06:50:34.741ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 57c7178e-0c1b-4716-9d43-77ca18e1ebbb, dataset_name: DatasetName { pool_name: ZpoolName { id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8942024-11-01T06:50:34.741ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 57c7178e-0c1b-4716-9d43-77ca18e1ebbb, dataset_name: DatasetName { pool_name: ZpoolName { id: d3002782-e4e6-4eb6-90d0-05203f9776aa (zpool), kind: External }, kind: Crucible }, responder: ... }
8952024-11-01T06:50:34.868ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37, dataset_name: DatasetName { pool_name: ZpoolName { id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8962024-11-01T06:50:34.868ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37, dataset_name: DatasetName { pool_name: ZpoolName { id: e1a43d6a-09dc-44d6-9940-8b3aa07b0871 (zpool), kind: External }, kind: Crucible }, responder: ... }
8972024-11-01T06:50:34.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 02b6df60-f053-4321-822c-c553be09f97c, dataset_name: DatasetName { pool_name: ZpoolName { id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8982024-11-01T06:50:34.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 02b6df60-f053-4321-822c-c553be09f97c, dataset_name: DatasetName { pool_name: ZpoolName { id: 415a68a1-91bd-446b-a587-2b70d19e26e9 (zpool), kind: External }, kind: Crucible }, responder: ... }
8992024-11-01T06:50:35.116ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 071518ac-91f9-41a6-97f8-754edd29f2b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9002024-11-01T06:50:35.116ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 071518ac-91f9-41a6-97f8-754edd29f2b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 950a040d-5cd2-426c-8ac9-53395920b1aa (zpool), kind: External }, kind: Crucible }, responder: ... }
9012024-11-01T06:50:35.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9022024-11-01T06:50:35.246ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
9032024-11-01T06:50:35.246ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
9042024-11-01T06:50:35.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9052024-11-01T06:50:35.417ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9062024-11-01T06:50:35.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9072024-11-01T06:50:35.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9082024-11-01T06:50:35.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9092024-11-01T06:50:35.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9102024-11-01T06:50:35.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9112024-11-01T06:50:35.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9122024-11-01T06:50:35.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9132024-11-01T06:50:35.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9142024-11-01T06:50:35.454ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9152024-11-01T06:50:35.638ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9162024-11-01T06:50:35.640ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9172024-11-01T06:50:35.654ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9182024-11-01T06:50:35.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9192024-11-01T06:50:35.666ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9202024-11-01T06:50:35.691ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9212024-11-01T06:50:35.691ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9222024-11-01T06:50:35.691ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9232024-11-01T06:50:35.691ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9242024-11-01T06:50:35.691ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68 file = illumos-utils/src/zone.rs:325
9252024-11-01T06:50:35.697ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af file = illumos-utils/src/zone.rs:325
9262024-11-01T06:50:35.702ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb file = illumos-utils/src/zone.rs:325
9272024-11-01T06:50:35.707ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef file = illumos-utils/src/zone.rs:325
9282024-11-01T06:50:35.713ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934 file = illumos-utils/src/zone.rs:325
9292024-11-01T06:50:35.719ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b file = illumos-utils/src/zone.rs:325
9302024-11-01T06:50:35.724ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37 file = illumos-utils/src/zone.rs:325
9312024-11-01T06:50:35.730ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3 file = illumos-utils/src/zone.rs:325
9322024-11-01T06:50:35.735ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2 file = illumos-utils/src/zone.rs:325
9332024-11-01T06:50:35.838ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68 file = illumos-utils/src/zone.rs:363
9342024-11-01T06:50:35.844ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af file = illumos-utils/src/zone.rs:363
9352024-11-01T06:50:35.849ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb file = illumos-utils/src/zone.rs:363
9362024-11-01T06:50:35.853ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef file = illumos-utils/src/zone.rs:363
9372024-11-01T06:50:35.857ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934 file = illumos-utils/src/zone.rs:363
9382024-11-01T06:50:35.862ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b file = illumos-utils/src/zone.rs:363
9392024-11-01T06:50:35.867ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37 file = illumos-utils/src/zone.rs:363
9402024-11-01T06:50:35.872ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3 file = illumos-utils/src/zone.rs:363
9412024-11-01T06:50:35.876ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2 file = illumos-utils/src/zone.rs:363
9422024-11-01T06:50:35.881ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c file = illumos-utils/src/zone.rs:325
9432024-11-01T06:50:35.886ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f file = illumos-utils/src/zone.rs:325
9442024-11-01T06:50:35.892ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e file = illumos-utils/src/zone.rs:325
9452024-11-01T06:50:35.897ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af file = illumos-utils/src/zone.rs:325
9462024-11-01T06:50:35.904ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923 file = illumos-utils/src/zone.rs:325
9472024-11-01T06:50:35.910ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c file = illumos-utils/src/zone.rs:363
9482024-11-01T06:50:35.915ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f file = illumos-utils/src/zone.rs:363
9492024-11-01T06:50:35.920ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e file = illumos-utils/src/zone.rs:363
9502024-11-01T06:50:35.926ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af file = illumos-utils/src/zone.rs:363
9512024-11-01T06:50:35.931ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923 file = illumos-utils/src/zone.rs:363
9522024-11-01T06:50:35.981ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9532024-11-01T06:50:36.057ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9542024-11-01T06:50:36.123ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9552024-11-01T06:50:36.181ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9562024-11-01T06:50:36.239ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9572024-11-01T06:50:36.241ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9582024-11-01T06:50:36.241ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9592024-11-01T06:50:36.296ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 151, 216]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9602024-11-01T06:50:36.296ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9612024-11-01T06:50:36.298ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9622024-11-01T06:50:36.298ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9632024-11-01T06:50:36.354ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 218, 142]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9642024-11-01T06:50:36.354ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
9652024-11-01T06:50:36.355ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9662024-11-01T06:50:36.356ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9672024-11-01T06:50:36.409ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 212, 42]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9682024-11-01T06:50:36.409ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9692024-11-01T06:50:36.410ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9702024-11-01T06:50:36.410ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9712024-11-01T06:50:36.461ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 137, 248]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9722024-11-01T06:50:36.461ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9732024-11-01T06:50:36.463ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9742024-11-01T06:50:36.463ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9752024-11-01T06:50:36.515ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 208, 86]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9762024-11-01T06:50:36.515ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
9772024-11-01T06:50:36.515ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
9782024-11-01T06:50:36.515ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
9792024-11-01T06:50:36.517ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
9802024-11-01T06:50:36.517ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
9812024-11-01T06:50:36.518ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
9822024-11-01T06:50:36.518ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
9832024-11-01T06:50:36.518ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
9842024-11-01T06:50:36.518ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
9852024-11-01T06:50:36.519ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
9862024-11-01T06:50:36.519ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
9872024-11-01T06:50:36.531ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
9882024-11-01T06:50:36.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9892024-11-01T06:50:36.579ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
9902024-11-01T06:50:36.582ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
9912024-11-01T06:50:36.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9922024-11-01T06:50:36.586ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
9932024-11-01T06:50:36.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9942024-11-01T06:50:36.589ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
9952024-11-01T06:50:36.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9962024-11-01T06:50:36.592ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9972024-11-01T06:50:36.759ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a file = illumos-utils/src/zone.rs:325
9982024-11-01T06:50:36.768ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7 file = illumos-utils/src/zone.rs:325
9992024-11-01T06:50:36.777ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0 file = illumos-utils/src/zone.rs:325
10002024-11-01T06:50:36.786ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 file = illumos-utils/src/zone.rs:325
10012024-11-01T06:50:36.796ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf file = illumos-utils/src/zone.rs:325
10022024-11-01T06:50:36.806ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a file = illumos-utils/src/zone.rs:363
10032024-11-01T06:50:36.815ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7 file = illumos-utils/src/zone.rs:363
10042024-11-01T06:50:36.825ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0 file = illumos-utils/src/zone.rs:363
10052024-11-01T06:50:36.835ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 file = illumos-utils/src/zone.rs:363
10062024-11-01T06:50:36.844ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf file = illumos-utils/src/zone.rs:363
10072024-11-01T06:50:38.809ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10082024-11-01T06:50:38.809ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
10092024-11-01T06:50:38.997ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d3002782-e4e6-4eb6-90d0-05203f9776aa/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cc7f88d6-3c68-4fc4-abb4-8d8bebb168cf'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10102024-11-01T06:50:39.026ZINFOSledAgent (ServiceManager): Booting oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
10112024-11-01T06:50:39.042ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fd147d75-70ba-4f51-bd1a-94ba187fecc6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11ec97a3-6332-4522-b89b-fef0200acea6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10122024-11-01T06:50:39.042ZINFOSledAgent (ServiceManager): Booting oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
10132024-11-01T06:50:39.080ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10142024-11-01T06:50:39.081ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
10152024-11-01T06:50:39.117ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_950a040d-5cd2-426c-8ac9-53395920b1aa/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='da32636a-d352-4ac5-9ff9-5caab66a20f1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10162024-11-01T06:50:39.131ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10172024-11-01T06:50:39.131ZINFOSledAgent (ServiceManager): Booting oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
10182024-11-01T06:50:39.136ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
10192024-11-01T06:50:39.230ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_415a68a1-91bd-446b-a587-2b70d19e26e9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7328b3bb-b547-4bd4-9967-e07473a97832'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10202024-11-01T06:50:39.231ZINFOSledAgent (ServiceManager): Booting oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
10212024-11-01T06:50:39.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 27.531795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
10222024-11-01T06:50:39.303ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9c422399-4aa1-4979-b10e-d7bb51cc9ea8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f4ad9fdb-9107-47ce-8f54-d59eca9cf822'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10232024-11-01T06:50:39.303ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
10242024-11-01T06:50:39.315ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e1a43d6a-09dc-44d6-9940-8b3aa07b0871/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='151bb242-e346-47cd-97b1-5e4bd74c3f75'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10252024-11-01T06:50:39.315ZINFOSledAgent (ServiceManager): Booting oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
10262024-11-01T06:50:39.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 143.294882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
10272024-11-01T06:50:39.350ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='0327dabc-65b9-4ac6-91b2-e03c8243f5ef'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10282024-11-01T06:50:39.350ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dd270633-6bc2-4925-9cc8-0d8cbe344d5c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a2652fae-1323-40aa-97ef-caed0a1fe656'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10292024-11-01T06:50:39.350ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
10302024-11-01T06:50:39.375ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ef152924-a63c-43bb-a571-2ff3b6071747/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f256ac9b-a9ee-4d9f-a6a8-494a943c73ae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10312024-11-01T06:50:39.376ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
10322024-11-01T06:50:39.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 70.413384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
10332024-11-01T06:50:39.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 58.920813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
10342024-11-01T06:50:39.480ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
10352024-11-01T06:50:39.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 250.102804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
10362024-11-01T06:50:39.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 42.579658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
10372024-11-01T06:50:39.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 43.298214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
10382024-11-01T06:50:39.726ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_97f3e142-6bfb-426e-92d5-9fe2f0689aa2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ca3e5381-5b6a-4f5c-88ac-41b582d92df4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10392024-11-01T06:50:39.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 136.17929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
10402024-11-01T06:50:39.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 63.847179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
10412024-11-01T06:50:40.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 270.775564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
10422024-11-01T06:50:40.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 38.532104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
10432024-11-01T06:50:40.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 57.771345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
10442024-11-01T06:50:40.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 75.220289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
10452024-11-01T06:50:40.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 65.325137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
10462024-11-01T06:50:40.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 59.325197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
10472024-11-01T06:50:40.810ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
10482024-11-01T06:50:40.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 230.65535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
10492024-11-01T06:50:40.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 149.78801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
10502024-11-01T06:50:40.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 31.539464ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
10512024-11-01T06:50:40.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 54.607543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
10522024-11-01T06:50:40.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.084176051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
10532024-11-01T06:50:40.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 43.935912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
10542024-11-01T06:50:40.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 121.033302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
10552024-11-01T06:50:40.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 32.461495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
10562024-11-01T06:50:40.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 63.656965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
10572024-11-01T06:50:40.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 259.370645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
10582024-11-01T06:50:40.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 184.229619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
10592024-11-01T06:50:40.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 67.891101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
10602024-11-01T06:50:41.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 143.596633ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
10612024-11-01T06:50:41.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 72.004985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
10622024-11-01T06:50:41.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 52.864492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
10632024-11-01T06:50:41.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 50.204666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
10642024-11-01T06:50:41.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 280.245661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
10652024-11-01T06:50:41.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 150.226553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
10662024-11-01T06:50:41.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 72.316153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
10672024-11-01T06:50:41.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 498.033386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
10682024-11-01T06:50:41.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 597.286677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
10692024-11-01T06:50:41.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 132.9898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
10702024-11-01T06:50:41.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 181.770792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
10712024-11-01T06:50:41.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 141.006501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
10722024-11-01T06:50:41.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 250.485171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
10732024-11-01T06:50:41.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 577.327566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
10742024-11-01T06:50:41.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 62.772203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
10752024-11-01T06:50:41.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 221.743386ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
10762024-11-01T06:50:41.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 417.491574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
10772024-11-01T06:50:41.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 330.06325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
10782024-11-01T06:50:41.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 279.975321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
10792024-11-01T06:50:41.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 230.1468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
10802024-11-01T06:50:41.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 502.048121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
10812024-11-01T06:50:41.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 535.147707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
10822024-11-01T06:50:41.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 298.526336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
10832024-11-01T06:50:41.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 229.545828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
10842024-11-01T06:50:41.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 590.638948ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
10852024-11-01T06:50:41.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 531.032701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
10862024-11-01T06:50:41.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 279.079192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
10872024-11-01T06:50:41.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.069090545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
10882024-11-01T06:50:41.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 426.124483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
10892024-11-01T06:50:41.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 787.170878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
10902024-11-01T06:50:41.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 556.613591ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
10912024-11-01T06:50:41.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 610.750013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
10922024-11-01T06:50:41.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 956.186284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
10932024-11-01T06:50:41.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 931.505971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
10942024-11-01T06:50:41.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 486.736402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
10952024-11-01T06:50:41.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.078767335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
10962024-11-01T06:50:41.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 864.365597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
10972024-11-01T06:50:42.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 527.20018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
10982024-11-01T06:50:42.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 789.464532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
10992024-11-01T06:50:42.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 914.348765ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
11002024-11-01T06:50:42.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.302060377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
11012024-11-01T06:50:42.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.169675799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
11022024-11-01T06:50:42.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 934.066874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
11032024-11-01T06:50:42.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.085649076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
11042024-11-01T06:50:42.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.4553906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
11052024-11-01T06:50:42.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.069292674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
11062024-11-01T06:50:43.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 785.346131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
11072024-11-01T06:50:43.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.437749525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
11082024-11-01T06:50:43.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.264146924s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
11092024-11-01T06:50:43.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 735.387071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
11102024-11-01T06:50:43.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 597.251394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
11112024-11-01T06:50:43.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 794.507004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
11122024-11-01T06:50:43.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.457108249s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
11132024-11-01T06:50:43.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.225562392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
11142024-11-01T06:50:43.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.378529637s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
11152024-11-01T06:50:44.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 573.100039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
11162024-11-01T06:50:44.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.169619892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
11172024-11-01T06:50:44.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.479275747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
11182024-11-01T06:50:44.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.412750956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
11192024-11-01T06:50:44.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 555.919185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
11202024-11-01T06:50:44.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 573.991013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
11212024-11-01T06:50:44.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.264084115s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
11222024-11-01T06:50:44.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.271786382s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
11232024-11-01T06:50:44.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.066576862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
11242024-11-01T06:50:44.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 740.619432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
11252024-11-01T06:50:44.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 513.751783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
11262024-11-01T06:50:44.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 766.598773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
11272024-11-01T06:50:44.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.474711411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
11282024-11-01T06:50:44.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 729.209874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
11292024-11-01T06:50:44.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 878.681418ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
11302024-11-01T06:50:44.997ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11312024-11-01T06:50:44.997ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
11322024-11-01T06:50:45.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 536.214734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
11332024-11-01T06:50:45.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 899.019612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
11342024-11-01T06:50:45.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.008593874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
11352024-11-01T06:50:45.490ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11362024-11-01T06:50:45.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.293932239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
11372024-11-01T06:50:45.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 998.604607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
11382024-11-01T06:50:45.535ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
11392024-11-01T06:50:45.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.328479242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
11402024-11-01T06:50:45.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 831.312745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
11412024-11-01T06:50:45.632ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11422024-11-01T06:50:45.633ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
11432024-11-01T06:50:45.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 835.686174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
11442024-11-01T06:50:47.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 42.980918ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
11452024-11-01T06:50:47.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.140397572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
11462024-11-01T06:50:47.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 698.018617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
11472024-11-01T06:50:47.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.433837667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
11482024-11-01T06:50:47.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 749.849499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
11492024-11-01T06:50:47.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.053297378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
11502024-11-01T06:50:47.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.365580724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
11512024-11-01T06:50:47.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 892.048431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
11522024-11-01T06:50:47.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.49132302s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
11532024-11-01T06:50:47.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.004984921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
11542024-11-01T06:50:47.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.380055782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
11552024-11-01T06:50:47.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.024894939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
11562024-11-01T06:50:47.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 944.202304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
11572024-11-01T06:50:47.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.238036342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
11582024-11-01T06:50:47.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 54.498758ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
11592024-11-01T06:50:47.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 52.003037ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
11602024-11-01T06:50:47.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 63.222656ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
11612024-11-01T06:50:47.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 255.943124ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
11622024-11-01T06:50:47.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 100.067036ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
11632024-11-01T06:50:47.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 77.080012ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
11642024-11-01T06:50:47.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 225.040496ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
11652024-11-01T06:50:47.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 250.491434ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
11662024-11-01T06:50:48.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 536.218083ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
11672024-11-01T06:50:48.104ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-11-01T06:50:48.104ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
11692024-11-01T06:50:48.114ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11702024-11-01T06:50:48.114ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
11712024-11-01T06:50:48.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 817.485963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
11722024-11-01T06:50:48.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 228.89999ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
11732024-11-01T06:50:48.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 324.285546ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
11742024-11-01T06:50:48.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.046071197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
11752024-11-01T06:50:48.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 47.379625ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
11762024-11-01T06:50:48.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 51.92529ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
11772024-11-01T06:50:48.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 896.031717ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
11782024-11-01T06:50:48.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 129.888646ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
11792024-11-01T06:50:48.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 63.577531ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
11802024-11-01T06:50:48.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 542.598328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
11812024-11-01T06:50:48.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 212.368709ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
11822024-11-01T06:50:48.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.079225758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
11832024-11-01T06:50:48.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 148.965605ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
11842024-11-01T06:50:48.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.011808067s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
11852024-11-01T06:50:48.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 641.439017ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
11862024-11-01T06:50:48.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 776.417078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
11872024-11-01T06:50:48.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 623.064477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
11882024-11-01T06:50:48.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.444223339s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
11892024-11-01T06:50:48.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.017319433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
11902024-11-01T06:50:48.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 569.573705ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
11912024-11-01T06:50:48.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 356.048626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
11922024-11-01T06:50:48.923ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932024-11-01T06:50:48.923ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
11942024-11-01T06:50:48.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.335537465s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
11952024-11-01T06:50:48.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.068106738s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
11962024-11-01T06:50:49.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 544.826361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
11972024-11-01T06:50:49.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.122843622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
11982024-11-01T06:50:49.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.271985124s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
11992024-11-01T06:50:49.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 520.33221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
12002024-11-01T06:50:49.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 585.349161ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
12012024-11-01T06:50:49.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.114814672s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
12022024-11-01T06:50:49.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 50.553918ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12032024-11-01T06:50:49.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 114.456431ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12042024-11-01T06:50:49.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.091259194s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
12052024-11-01T06:50:49.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 899.187162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
12062024-11-01T06:50:49.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 591.944127ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
12072024-11-01T06:50:49.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.245529099s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
12082024-11-01T06:50:49.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 144.188961ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12092024-11-01T06:50:49.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.365291872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
12102024-11-01T06:50:49.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 833.741916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
12112024-11-01T06:50:49.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 507.165144ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12122024-11-01T06:50:49.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 769.450124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
12132024-11-01T06:50:49.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.388285955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
12142024-11-01T06:50:49.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 850.871817ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
12152024-11-01T06:50:49.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 580.939414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
12162024-11-01T06:50:49.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 844.346942ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
12172024-11-01T06:50:49.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 940.599917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
12182024-11-01T06:50:49.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 747.282758ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
12192024-11-01T06:50:50.066ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.808001453s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 66656a2e-362d-410c-b905-3979762845f4
12202024-11-01T06:50:50.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 640.448621ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12212024-11-01T06:50:50.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 851.459004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
12222024-11-01T06:50:50.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.119335992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
12232024-11-01T06:50:50.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 845.623242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
12242024-11-01T06:50:50.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.460548134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
12252024-11-01T06:50:50.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.387508945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
12262024-11-01T06:50:50.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 610.409837ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
12272024-11-01T06:50:50.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 994.480562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
12282024-11-01T06:50:50.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.280911802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
12292024-11-01T06:50:50.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 964.229279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
12302024-11-01T06:50:50.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.158363432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
12312024-11-01T06:50:50.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.055520675s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
12322024-11-01T06:50:50.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.454049005s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
12332024-11-01T06:50:50.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.280382409s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
12342024-11-01T06:50:50.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 806.895421ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
12352024-11-01T06:50:50.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 899.997166ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
12362024-11-01T06:50:50.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 720.000923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
12372024-11-01T06:50:50.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.122526111s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12382024-11-01T06:50:50.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.015305066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
12392024-11-01T06:50:50.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 935.619827ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
12402024-11-01T06:50:50.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.086111841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
12412024-11-01T06:50:51.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.103253943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
12422024-11-01T06:50:51.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 674.120338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
12432024-11-01T06:50:51.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.132181967s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
12442024-11-01T06:50:51.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 839.871791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
12452024-11-01T06:50:51.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 514.941536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
12462024-11-01T06:50:51.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.010158241s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
12472024-11-01T06:50:51.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 773.712678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
12482024-11-01T06:50:51.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.068941414s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
12492024-11-01T06:50:51.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 639.777078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
12502024-11-01T06:50:51.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.062582554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
12512024-11-01T06:50:51.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.271970236s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
12522024-11-01T06:50:51.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.327823199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
12532024-11-01T06:50:51.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 956.953998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
12542024-11-01T06:50:51.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 883.511893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
12552024-11-01T06:50:51.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.066740927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
12562024-11-01T06:50:51.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.049658852s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
12572024-11-01T06:50:51.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.117036561s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12582024-11-01T06:50:51.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 591.517304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
12592024-11-01T06:50:51.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.087983635s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
12602024-11-01T06:50:51.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 518.065634ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
12612024-11-01T06:50:52.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 626.24141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
12622024-11-01T06:50:52.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.037508726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
12632024-11-01T06:50:52.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 821.708091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
12642024-11-01T06:50:52.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.325311937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
12652024-11-01T06:50:52.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 711.530641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
12662024-11-01T06:50:52.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 685.578484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
12672024-11-01T06:50:52.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 972.379115ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
12682024-11-01T06:50:52.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.113523882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
12692024-11-01T06:50:52.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.209174073s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
12702024-11-01T06:50:52.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 564.607403ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
12712024-11-01T06:50:52.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 548.363362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
12722024-11-01T06:50:52.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.240124049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
12732024-11-01T06:50:52.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.118624838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
12742024-11-01T06:50:52.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 656.115929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
12752024-11-01T06:50:52.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 803.050347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
12762024-11-01T06:50:52.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.444035867s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
12772024-11-01T06:50:52.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 693.992603ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
12782024-11-01T06:50:52.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.426289127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
12792024-11-01T06:50:52.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.4833693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
12802024-11-01T06:50:52.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.20480983s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
12812024-11-01T06:50:52.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 644.080972ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12822024-11-01T06:50:53.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 526.439927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
12832024-11-01T06:50:53.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.026120236s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
12842024-11-01T06:50:53.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.030277407s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
12852024-11-01T06:50:53.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 990.781496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
12862024-11-01T06:50:53.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 590.64435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
12872024-11-01T06:50:53.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 732.088945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
12882024-11-01T06:50:53.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 666.287619ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
12892024-11-01T06:50:53.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.003632138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
12902024-11-01T06:50:53.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 944.211475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
12912024-11-01T06:50:53.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 940.416704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
12922024-11-01T06:50:53.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 684.242181ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
12932024-11-01T06:50:53.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 838.883339ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
12942024-11-01T06:50:53.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.209127333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
12952024-11-01T06:50:53.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.125293029s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
12962024-11-01T06:50:53.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.231438002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
12972024-11-01T06:50:53.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.443814923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
12982024-11-01T06:50:53.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.258323421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
12992024-11-01T06:50:54.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.02224705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
13002024-11-01T06:50:54.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 652.005842ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
13012024-11-01T06:50:54.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.28103372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
13022024-11-01T06:50:54.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.409149074s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
13032024-11-01T06:50:54.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.007945153s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
13042024-11-01T06:50:54.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 617.3126ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
13052024-11-01T06:50:54.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 718.286828ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
13062024-11-01T06:50:54.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 616.206994ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
13072024-11-01T06:50:54.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 701.276015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
13082024-11-01T06:50:54.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.446584252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
13092024-11-01T06:50:54.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 742.60172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
13102024-11-01T06:50:54.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.094626053s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
13112024-11-01T06:50:54.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 936.382946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
13122024-11-01T06:50:54.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 826.177594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
13132024-11-01T06:50:54.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 936.407366ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
13142024-11-01T06:50:54.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.185780366s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
13152024-11-01T06:50:54.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 572.407167ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
13162024-11-01T06:50:54.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.084137945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
13172024-11-01T06:50:55.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 810.560113ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
13182024-11-01T06:50:55.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 864.514836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
13192024-11-01T06:50:55.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.247200058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
13202024-11-01T06:50:55.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.420295254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
13212024-11-01T06:50:55.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 974.99911ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
13222024-11-01T06:50:55.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 908.175675ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
13232024-11-01T06:50:55.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.284177864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
13242024-11-01T06:50:55.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.023926993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
13252024-11-01T06:50:55.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.09421478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
13262024-11-01T06:50:55.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.074753151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
13272024-11-01T06:50:55.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.020761342s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
13282024-11-01T06:50:55.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.356653621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
13292024-11-01T06:50:55.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.272039993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
13302024-11-01T06:50:55.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 557.546131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
13312024-11-01T06:50:55.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.347097472s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
13322024-11-01T06:50:55.615ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38842
13332024-11-01T06:50:55.617ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 490 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38842 req_id = 21684bdd-a9f4-4fad-8158-b00f032b82a8 response_code = 200 uri = /baseboard
13342024-11-01T06:50:55.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.054218669s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
13352024-11-01T06:50:55.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 770.211456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
13362024-11-01T06:50:55.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.229195115s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
13372024-11-01T06:50:55.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.274578558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
13382024-11-01T06:50:56.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 945.161897ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
13392024-11-01T06:50:56.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.450168489s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
13402024-11-01T06:50:56.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.425899185s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
13412024-11-01T06:50:56.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 745.570318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
13422024-11-01T06:50:56.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 893.796689ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
13432024-11-01T06:50:56.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 722.557076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
13442024-11-01T06:50:56.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 871.178175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
13452024-11-01T06:50:56.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.235108292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
13462024-11-01T06:50:56.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 715.612942ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
13472024-11-01T06:50:56.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 831.551517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
13482024-11-01T06:50:56.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 784.109195ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
13492024-11-01T06:50:56.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.37835935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
13502024-11-01T06:50:56.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 980.463955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
13512024-11-01T06:50:56.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 966.908021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
13522024-11-01T06:50:56.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.020005235s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
13532024-11-01T06:50:56.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.095634679s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
13542024-11-01T06:50:56.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.079730938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
13552024-11-01T06:50:56.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.168267278s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
13562024-11-01T06:50:56.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.19275513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
13572024-11-01T06:50:57.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.285261631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
13582024-11-01T06:50:57.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.183392604s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
13592024-11-01T06:50:57.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 708.459162ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
13602024-11-01T06:50:57.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 748.12795ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
13612024-11-01T06:50:57.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 946.539888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
13622024-11-01T06:50:57.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 980.660052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
13632024-11-01T06:50:57.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.430248372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
13642024-11-01T06:50:57.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 687.550701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
13652024-11-01T06:50:57.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.319365124s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
13662024-11-01T06:50:57.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.134304916s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
13672024-11-01T06:50:57.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 631.383568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
13682024-11-01T06:50:57.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 756.690124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
13692024-11-01T06:50:57.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.083224288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
13702024-11-01T06:50:57.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 531.204752ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
13712024-11-01T06:50:57.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.088756628s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
13722024-11-01T06:50:57.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.437274411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
13732024-11-01T06:50:57.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.275482417s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
13742024-11-01T06:50:57.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.026378499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
13752024-11-01T06:50:57.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 699.136163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
13762024-11-01T06:50:58.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.432421397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
13772024-11-01T06:50:58.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.110426099s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
13782024-11-01T06:50:58.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.181083566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
13792024-11-01T06:50:58.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.02232856s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
13802024-11-01T06:50:58.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.475918683s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
13812024-11-01T06:50:58.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.257448227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
13822024-11-01T06:50:58.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.440177317s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
13832024-11-01T06:50:58.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 858.396494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
13842024-11-01T06:50:58.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 536.366549ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
13852024-11-01T06:50:58.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 503.606316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
13862024-11-01T06:50:58.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 940.919229ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
13872024-11-01T06:50:58.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.492128965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
13882024-11-01T06:50:58.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.339891281s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
13892024-11-01T06:50:58.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 768.867102ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
13902024-11-01T06:50:58.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.431790561s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
13912024-11-01T06:50:58.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.057264528s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
13922024-11-01T06:50:58.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 632.582047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
13932024-11-01T06:50:59.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.291409889s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
13942024-11-01T06:50:59.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.40742056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
13952024-11-01T06:50:59.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.083651628s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
13962024-11-01T06:50:59.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.062677916s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
13972024-11-01T06:50:59.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 874.361558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
13982024-11-01T06:50:59.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 991.674527ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
13992024-11-01T06:50:59.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 688.58675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
14002024-11-01T06:50:59.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.085355993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
14012024-11-01T06:50:59.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.322053615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
14022024-11-01T06:50:59.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.427531881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
14032024-11-01T06:50:59.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.335931879s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
14042024-11-01T06:50:59.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 932.590583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
14052024-11-01T06:50:59.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.352109681s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
14062024-11-01T06:50:59.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.482470253s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
14072024-11-01T06:50:59.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 931.408767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
14082024-11-01T06:50:59.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.057667466s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
14092024-11-01T06:51:00.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 630.20596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
14102024-11-01T06:51:00.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.173215118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
14112024-11-01T06:51:00.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.01967794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
14122024-11-01T06:51:00.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.456364903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
14132024-11-01T06:51:00.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 536.767509ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
14142024-11-01T06:51:00.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 892.375429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
14152024-11-01T06:51:00.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 548.631326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
14162024-11-01T06:51:00.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 916.407775ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
14172024-11-01T06:51:00.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.065106875s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
14182024-11-01T06:51:00.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.347076456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
14192024-11-01T06:51:00.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 854.76031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
14202024-11-01T06:51:00.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 793.087879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
14212024-11-01T06:51:00.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.125597309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
14222024-11-01T06:51:00.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 834.422156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
14232024-11-01T06:51:00.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.069625551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
14242024-11-01T06:51:00.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.480801634s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
14252024-11-01T06:51:00.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.123869957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
14262024-11-01T06:51:00.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 552.295634ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
14272024-11-01T06:51:00.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.316438023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
14282024-11-01T06:51:01.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.241019588s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
14292024-11-01T06:51:01.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 761.442677ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
14302024-11-01T06:51:01.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.382501938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
14312024-11-01T06:51:01.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 998.302203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
14322024-11-01T06:51:01.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.307320755s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
14332024-11-01T06:51:01.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.11556276s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
14342024-11-01T06:51:01.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.04326199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
14352024-11-01T06:51:01.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 874.005319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
14362024-11-01T06:51:01.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 777.548186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
14372024-11-01T06:51:01.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 519.28191ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
14382024-11-01T06:51:01.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.408186074s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
14392024-11-01T06:51:01.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 957.768099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
14402024-11-01T06:51:01.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 939.428105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
14412024-11-01T06:51:01.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 821.534683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
14422024-11-01T06:51:01.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.33048773s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
14432024-11-01T06:51:01.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 764.883254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
14442024-11-01T06:51:01.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.086481168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
14452024-11-01T06:51:01.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 857.36385ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
14462024-11-01T06:51:01.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.390643647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
14472024-11-01T06:51:02.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 811.99086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
14482024-11-01T06:51:02.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 978.713774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
14492024-11-01T06:51:02.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 953.136537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
14502024-11-01T06:51:02.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.385481408s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
14512024-11-01T06:51:02.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.240086363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
14522024-11-01T06:51:02.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 984.329804ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
14532024-11-01T06:51:02.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.092238879s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
14542024-11-01T06:51:02.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 530.083998ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
14552024-11-01T06:51:02.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 1.391075696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
14562024-11-01T06:51:02.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.014941896s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
14572024-11-01T06:51:02.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 963.261056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
14582024-11-01T06:51:02.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 526.546468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
14592024-11-01T06:51:02.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 972.536506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
14602024-11-01T06:51:02.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.199033253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
14612024-11-01T06:51:02.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.400865806s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
14622024-11-01T06:51:02.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 972.276997ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
14632024-11-01T06:51:02.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 933.200192ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
14642024-11-01T06:51:02.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 626.009735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
14652024-11-01T06:51:03.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 863.94285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
14662024-11-01T06:51:03.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 905.583866ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
14672024-11-01T06:51:03.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.391292048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
14682024-11-01T06:51:03.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 1.384190494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
14692024-11-01T06:51:03.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 950.122523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
14702024-11-01T06:51:03.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.202160862s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
14712024-11-01T06:51:03.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 568.598659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
14722024-11-01T06:51:03.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 726.220835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
14732024-11-01T06:51:03.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.405032513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
14742024-11-01T06:51:03.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.473104919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
14752024-11-01T06:51:03.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.49210675s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
14762024-11-01T06:51:03.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 786.791908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
14772024-11-01T06:51:03.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.112606588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
14782024-11-01T06:51:03.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.043392284s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
14792024-11-01T06:51:03.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 929.075747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
14802024-11-01T06:51:03.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.031496739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
14812024-11-01T06:51:03.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 774.352761ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
14822024-11-01T06:51:03.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.034361746s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
14832024-11-01T06:51:03.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934") failed: Property not found. retry in 789.995812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
14842024-11-01T06:51:03.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 566.741774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
14852024-11-01T06:51:04.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.452825906s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
14862024-11-01T06:51:04.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 1.382554067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
14872024-11-01T06:51:04.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 906.621916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
14882024-11-01T06:51:04.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.458979824s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
14892024-11-01T06:51:04.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 1.163026552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
14902024-11-01T06:51:04.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.271197021s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
14912024-11-01T06:51:04.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.053278443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
14922024-11-01T06:51:04.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.4856358s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
14932024-11-01T06:51:04.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 735.865408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
14942024-11-01T06:51:04.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.279251943s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
14952024-11-01T06:51:04.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 557.137232ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
14962024-11-01T06:51:04.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.246651863s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
14972024-11-01T06:51:04.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 1.252724631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
14982024-11-01T06:51:04.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 1.478807926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
14992024-11-01T06:51:04.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162") failed: Property not found. retry in 1.450293452s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
15002024-11-01T06:51:04.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 1.408378776s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
15012024-11-01T06:51:05.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.40990949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
15022024-11-01T06:51:05.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.425098967s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
15032024-11-01T06:51:05.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 1.079418637s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
15042024-11-01T06:51:05.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.077367115s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
15052024-11-01T06:51:05.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 528.861623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
15062024-11-01T06:51:05.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.071467343s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
15072024-11-01T06:51:05.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 869.224421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
15082024-11-01T06:51:05.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 961.18023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
15092024-11-01T06:51:05.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3") failed: Property not found. retry in 1.235972604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
15102024-11-01T06:51:05.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef") failed: Property not found. retry in 1.238595295s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
15112024-11-01T06:51:05.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68") failed: Property not found. retry in 1.23417059s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
15122024-11-01T06:51:05.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c") failed: Property not found. retry in 843.926218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
15132024-11-01T06:51:05.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 614.74142ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
15142024-11-01T06:51:06.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 604.542032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
15152024-11-01T06:51:06.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f") failed: Property not found. retry in 571.471384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
15162024-11-01T06:51:06.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37") failed: Property not found. retry in 1.036671716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
15172024-11-01T06:51:06.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923") failed: Property not found. retry in 852.791791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
15182024-11-01T06:51:06.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7") failed: Property not found. retry in 1.077074473s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
15192024-11-01T06:51:06.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af") failed: Property not found. retry in 572.78482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
15202024-11-01T06:51:06.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb") failed: Property not found. retry in 831.783869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
15212024-11-01T06:51:06.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b") failed: Property not found. retry in 919.308182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
15222024-11-01T06:51:06.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e") failed: Property not found. retry in 1.274074106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
15232024-11-01T06:51:06.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf") failed: Property not found. retry in 1.330792038s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
15242024-11-01T06:51:06.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af") failed: Property not found. retry in 566.921361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
15252024-11-01T06:51:06.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a") failed: Property not found. retry in 1.218538713s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
15262024-11-01T06:51:06.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0") failed: Property not found. retry in 1.130566931s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
15272024-11-01T06:51:06.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2") failed: Property not found. retry in 1.034885913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
15282024-11-01T06:51:07.901ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_d64435a0-4078-422f-a13c-9a7f6a3b6c68
15292024-11-01T06:51:07.901ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_26b05373-1d31-4bbe-996c-abec39e796af
15302024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_57c7178e-0c1b-4716-9d43-77ca18e1ebbb
15312024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_0327dabc-65b9-4ac6-91b2-e03c8243f5ef
15322024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_3a30bff9-17ec-4a3d-9028-d513ecc74934
15332024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_5aa7528a-ef22-4dfb-afba-980d8c246f4a
15342024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_db7e45a1-64f0-4cc1-9722-ad2c475ce26b
15352024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_51537fa9-0ce7-4189-8bb3-0bcdfdb3cf37
15362024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_071518ac-91f9-41a6-97f8-754edd29f2b3
15372024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_e8e12190-7b9e-49c5-a57c-0696fecf22e2
15382024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_afcf56b3-6c52-4787-9733-ac81e42c29e7
15392024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_8d1426fc-0515-4a6d-979c-e17b886264e0
15402024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_02b6df60-f053-4321-822c-c553be09f97c
15412024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_3e06a3b3-fdb2-4151-bcdc-6ac53a43e162
15422024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf
15432024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_ed656401-1ee1-4946-94a6-1647da58448f
15442024-11-01T06:51:07.902ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_ab04a5dd-b232-4cb3-a748-cbf80211f85e
15452024-11-01T06:51:07.909ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_9d86389c-d875-41a4-8ff1-cd71502d75af
15462024-11-01T06:51:07.909ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_b216de2d-e219-4f4b-aea1-e5a389db1923
15472024-11-01T06:51:07.910ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15482024-11-01T06:51:07.912ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15492024-11-01T06:51:07.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34244235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59218 req_id = 3ded0489-63e9-40b9-9a5d-08ebf7a85ccc response_code = 204 uri = /omicron-zones
15502024-11-01T06:51:07.924ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1322
15512024-11-01T06:51:07.924ZINFOSledAgent (RSS): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15522024-11-01T06:51:07.924ZINFOSledAgent (RSS): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15532024-11-01T06:51:08.145ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
15542024-11-01T06:51:08.152ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:720
15552024-11-01T06:51:08.198ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:887
15562024-11-01T06:51:08.200ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15572024-11-01T06:51:08.340ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15582024-11-01T06:51:08.453ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15592024-11-01T06:51:08.644ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15602024-11-01T06:51:08.868ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15612024-11-01T06:51:09.179ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15622024-11-01T06:51:09.547ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15632024-11-01T06:51:09.890ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15642024-11-01T06:51:10.123ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.539399584s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 66656a2e-362d-410c-b905-3979762845f4
15652024-11-01T06:51:10.341ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15662024-11-01T06:51:10.892ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15672024-11-01T06:51:11.162ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15682024-11-01T06:51:11.945ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15692024-11-01T06:51:12.545ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15702024-11-01T06:51:13.231ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15712024-11-01T06:51:14.386ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15722024-11-01T06:51:15.183ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15732024-11-01T06:51:16.341ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15742024-11-01T06:51:17.696ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.999957229s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 66656a2e-362d-410c-b905-3979762845f4
15752024-11-01T06:51:19.110ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e3a0579d-db41-429a-a770-e6cab66d0ec4/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15762024-11-01T06:51:21.019ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7c38ac35-0411-4fd5-bd13-deb2406c436a", "content-length": "173", "date": "Fri, 01 Nov 2024 06:51:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e3a0579d-db41-429a-a770-e6cab66d0ec4\"", request_id: "7c38ac35-0411-4fd5-bd13-deb2406c436a" } file = sled-agent/src/rack_setup/service.rs:949
15772024-11-01T06:51:25.185ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "edbb5928-70a6-4155-8d2e-d13c005049e2", "content-length": "173", "date": "Fri, 01 Nov 2024 06:51:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"66656a2e-362d-410c-b905-3979762845f4\"", request_id: "edbb5928-70a6-4155-8d2e-d13c005049e2" } file = sled-agent/src/rack_setup/service.rs:949
15782024-11-01T06:51:25.655ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49986
15792024-11-01T06:51:25.655ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49986 req_id = 6c4ab965-d75e-436b-a4f6-35ea659f8ece response_code = 200 uri = /baseboard
15802024-11-01T06:51:29.648ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9c6db795-6f14-4f2a-9583-34016433c1f6", "content-length": "173", "date": "Fri, 01 Nov 2024 06:51:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"66656a2e-362d-410c-b905-3979762845f4\"", request_id: "9c6db795-6f14-4f2a-9583-34016433c1f6" } file = sled-agent/src/rack_setup/service.rs:949
15812024-11-01T06:51:35.329ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2b83384a-1cc2-47d2-b258-e4ff9c709eb4", "content-length": "173", "date": "Fri, 01 Nov 2024 06:51:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"66656a2e-362d-410c-b905-3979762845f4\"", request_id: "2b83384a-1cc2-47d2-b258-e4ff9c709eb4" } file = sled-agent/src/rack_setup/service.rs:949
15822024-11-01T06:51:36.032ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:65472 remote_addr = [fd00:1122:3344:101::d]:36040 sled_id = 66656a2e-362d-410c-b905-3979762845f4
15832024-11-01T06:51:36.056ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23762 local_addr = [fd00:1122:3344:101::1]:65472 method = GET remote_addr = [fd00:1122:3344:101::d]:36040 req_id = 73179246-1069-4cbf-94a5-c43f11dd4897 response_code = 200 sled_id = 66656a2e-362d-410c-b905-3979762845f4 uri = /66656a2e-362d-410c-b905-3979762845f4
15842024-11-01T06:51:42.405ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a82de19c-31f2-4e2c-a8b8-1cd44f081a26", "content-length": "173", "date": "Fri, 01 Nov 2024 06:51:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"66656a2e-362d-410c-b905-3979762845f4\"", request_id: "a82de19c-31f2-4e2c-a8b8-1cd44f081a26" } file = sled-agent/src/rack_setup/service.rs:949
15852024-11-01T06:51:45.154ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 66656a2e-362d-410c-b905-3979762845f4
15862024-11-01T06:51:45.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56634
15872024-11-01T06:51:45.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15882024-11-01T06:51:45.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15892024-11-01T06:51:45.276ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
15902024-11-01T06:51:45.278ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
15912024-11-01T06:51:45.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56634 req_id = ff343f8f-13b2-4347-bdb1-066c7f30afa1 response_code = 200 uri = /inventory
15922024-11-01T06:51:46.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39876
15932024-11-01T06:51:46.322ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15942024-11-01T06:51:46.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15952024-11-01T06:51:46.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15962024-11-01T06:51:46.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15972024-11-01T06:51:46.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15982024-11-01T06:51:46.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15992024-11-01T06:51:46.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16002024-11-01T06:51:46.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39876 req_id = 5f7720bc-284b-45ae-bd68-722b14973f22 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16012024-11-01T06:51:46.325ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:959
16022024-11-01T06:51:46.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46748
16032024-11-01T06:51:46.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16042024-11-01T06:51:46.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16052024-11-01T06:51:46.603ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
16062024-11-01T06:51:46.604ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
16072024-11-01T06:51:46.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46748 req_id = 13aa4d43-5295-44b2-aa88-724ed090521d response_code = 200 uri = /inventory
16082024-11-01T06:51:47.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38766
16092024-11-01T06:51:47.667ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16102024-11-01T06:51:47.668ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16112024-11-01T06:51:47.668ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16122024-11-01T06:51:47.668ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16132024-11-01T06:51:47.668ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16142024-11-01T06:51:47.668ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16152024-11-01T06:51:47.668ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16162024-11-01T06:51:47.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38766 req_id = a6362e9b-eb21-4147-ba11-87f8f92d783c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16172024-11-01T06:51:48.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56115
16182024-11-01T06:51:48.045ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16192024-11-01T06:51:48.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16202024-11-01T06:51:48.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16212024-11-01T06:51:48.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16222024-11-01T06:51:48.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16232024-11-01T06:51:48.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16242024-11-01T06:51:48.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16252024-11-01T06:51:48.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56115 req_id = 8ac960be-96f7-4fc1-ba9a-50c5650921c0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16262024-11-01T06:51:48.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52007
16272024-11-01T06:51:48.067ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16282024-11-01T06:51:48.067ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16292024-11-01T06:51:48.067ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16302024-11-01T06:51:48.067ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16312024-11-01T06:51:48.067ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16322024-11-01T06:51:48.067ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16332024-11-01T06:51:48.067ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16342024-11-01T06:51:48.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52007 req_id = 0720b107-5cdd-4256-b8e1-2be802d2182e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16352024-11-01T06:51:51.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55108
16362024-11-01T06:51:51.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 559 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55108 req_id = 5a7aa36d-952f-4708-a11c-252211126115 response_code = 200 uri = /vpc-routes
16372024-11-01T06:51:51.493ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
16382024-11-01T06:51:51.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 655 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55108 req_id = 1da5e743-0e82-4386-b6c2-91134453c222 response_code = 204 uri = /eip-gateways
16392024-11-01T06:51:51.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48578
16402024-11-01T06:51:51.718ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16412024-11-01T06:51:51.812ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16422024-11-01T06:51:51.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48578 req_id = b8044ac4-d907-4324-a8de-b171819cc423 response_code = 204 uri = /switch-ports
16432024-11-01T06:51:51.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56580
16442024-11-01T06:51:51.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56580 req_id = 4ad9a5c6-d216-4fdf-b35c-e860e1dc8da6 response_code = 200 uri = /v2p
16452024-11-01T06:51:51.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48578 req_id = aff7e3c9-8a52-4c84-9e85-310b853b7d3e response_code = 200 uri = /network-bootstore-config
16462024-11-01T06:51:51.932ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16472024-11-01T06:51:51.932ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16482024-11-01T06:51:51.932ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16492024-11-01T06:51:51.933ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16502024-11-01T06:51:51.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2804 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48578 req_id = 4cc03b4a-d557-45de-91ae-ba7a99a1af50 response_code = 204 uri = /network-bootstore-config
16512024-11-01T06:51:51.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48069
16522024-11-01T06:51:51.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48069 req_id = c04fcfbb-f770-4692-8b05-8ba78a8461fa response_code = 200 uri = /vpc-routes
16532024-11-01T06:51:51.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
16542024-11-01T06:51:51.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48069 req_id = 2ed32b05-1766-48c8-b633-bca66f7ee13d response_code = 204 uri = /eip-gateways
16552024-11-01T06:51:52.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3626 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55108 req_id = 2b6accfd-e20b-4183-8f64-1e5ec9032afd response_code = 204 uri = /vpc-routes
16562024-11-01T06:51:52.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52720
16572024-11-01T06:51:52.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52720 req_id = 27cff1fe-a616-4803-bb94-c7825cb5ba13 response_code = 200 uri = /v2p
16582024-11-01T06:51:52.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36812
16592024-11-01T06:51:52.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36812 req_id = cdaeaf37-3994-495a-8865-098af26ed08a response_code = 200 uri = /vpc-routes
16602024-11-01T06:51:52.320ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
16612024-11-01T06:51:52.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36812 req_id = bca8cd92-a435-430b-94a9-328f7d356fbb response_code = 204 uri = /eip-gateways
16622024-11-01T06:51:52.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62553
16632024-11-01T06:51:52.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62553 req_id = 071f383a-35da-4c77-a5ef-6b6f1c14d284 response_code = 200 uri = /vpc-routes
16642024-11-01T06:51:52.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65268
16652024-11-01T06:51:52.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16662024-11-01T06:51:52.382ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16672024-11-01T06:51:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65268 req_id = 3b841946-5196-4252-8939-ff591e7e6466 response_code = 204 uri = /switch-ports
16682024-11-01T06:51:52.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
16692024-11-01T06:51:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62553 req_id = 670e0c40-cd96-4cf5-981b-63b173e1b55c response_code = 204 uri = /eip-gateways
16702024-11-01T06:51:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65268 req_id = 8ae4135b-a56f-4a37-bc3c-05e3f7ccbc23 response_code = 200 uri = /network-bootstore-config
16712024-11-01T06:51:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36812 req_id = 04bafa51-0813-4709-877f-7e4401d30e81 response_code = 204 uri = /vpc-routes
16722024-11-01T06:51:52.460ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
16732024-11-01T06:51:52.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 802 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48069 req_id = 7f55a03b-e7c1-45f5-9d69-5f76f6576951 response_code = 204 uri = /vpc-routes
16742024-11-01T06:51:52.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62553 req_id = fc8e73df-49e0-4422-ad74-b43adfcd7f7a response_code = 204 uri = /vpc-routes
16752024-11-01T06:51:52.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57846
16762024-11-01T06:51:52.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16772024-11-01T06:51:52.682ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16782024-11-01T06:51:52.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107272 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57846 req_id = a70578d2-3294-44ba-81dc-a48691a2ca01 response_code = 204 uri = /switch-ports
16792024-11-01T06:51:52.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34028
16802024-11-01T06:51:52.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57846 req_id = ffa9a930-88aa-4752-a3ff-28f0a185d3c9 response_code = 200 uri = /network-bootstore-config
16812024-11-01T06:51:52.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34028 req_id = 3efe09a5-0638-484c-8d6b-3398daccb821 response_code = 200 uri = /v2p
16822024-11-01T06:51:55.690ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51760
16832024-11-01T06:51:55.690ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51760 req_id = 3ba1907f-a2e3-458c-b926-3388161cfe8d response_code = 200 uri = /baseboard
16842024-11-01T06:52:21.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64381
16852024-11-01T06:52:21.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64381 req_id = f063189c-6fb3-4b04-b963-0bf38d720c67 response_code = 200 uri = /vpc-routes
16862024-11-01T06:52:21.671ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
16872024-11-01T06:52:21.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64381 req_id = c68cd150-7b6b-4802-b0c5-101fec3bec99 response_code = 204 uri = /eip-gateways
16882024-11-01T06:52:21.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64381 req_id = 37b39325-bcac-4961-8abf-f242e36bdd7d response_code = 204 uri = /vpc-routes
16892024-11-01T06:52:21.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57838
16902024-11-01T06:52:21.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57838 req_id = 03619eba-b434-4e1e-b006-8324bfb313cf response_code = 200 uri = /v2p
16912024-11-01T06:52:21.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64036
16922024-11-01T06:52:21.758ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16932024-11-01T06:52:21.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16942024-11-01T06:52:21.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64036 req_id = 6f5ab268-18e8-47af-96f9-3a8fbffa663e response_code = 204 uri = /switch-ports
16952024-11-01T06:52:21.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64036 req_id = d5510582-0aaf-4088-a22d-6be85f10bc2f response_code = 200 uri = /network-bootstore-config
16962024-11-01T06:52:21.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48182
16972024-11-01T06:52:21.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48182 req_id = 5651cf39-0c99-4b57-a209-1efa0755790e response_code = 200 uri = /vpc-routes
16982024-11-01T06:52:21.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
16992024-11-01T06:52:21.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48182 req_id = f5136bb4-7f8a-4cae-874c-d491a32fe345 response_code = 204 uri = /eip-gateways
17002024-11-01T06:52:21.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48182 req_id = f86b0241-48bd-4f9b-9656-7f1cd866470f response_code = 204 uri = /vpc-routes
17012024-11-01T06:52:22.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64123
17022024-11-01T06:52:22.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64123 req_id = b793b902-fb7b-449f-aa76-7e3052af0ea0 response_code = 200 uri = /v2p
17032024-11-01T06:52:22.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49684
17042024-11-01T06:52:22.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49684 req_id = 548ac17b-0aab-4786-ba6a-2898eb00a791 response_code = 200 uri = /vpc-routes
17052024-11-01T06:52:22.398ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
17062024-11-01T06:52:22.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49684 req_id = 0decad49-fc48-49e8-8cce-2ddcb8ba58db response_code = 204 uri = /eip-gateways
17072024-11-01T06:52:22.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57002
17082024-11-01T06:52:22.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17092024-11-01T06:52:22.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17102024-11-01T06:52:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57002 req_id = 22e7ca6b-33aa-4c5b-9b50-eccad5d9f3cc response_code = 204 uri = /switch-ports
17112024-11-01T06:52:22.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33663
17122024-11-01T06:52:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49684 req_id = fdff0057-c571-4481-aad7-f0a6607ca3e6 response_code = 204 uri = /vpc-routes
17132024-11-01T06:52:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57002 req_id = eb797f11-5971-41b6-8376-374c346792be response_code = 200 uri = /network-bootstore-config
17142024-11-01T06:52:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33663 req_id = 36c09866-5d99-4f6c-9cc8-052781cdd11f response_code = 200 uri = /v2p
17152024-11-01T06:52:22.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36825
17162024-11-01T06:52:22.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17172024-11-01T06:52:22.627ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17182024-11-01T06:52:22.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91819 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36825 req_id = 838b20c0-5a12-452f-b38b-8fd82d2754f3 response_code = 204 uri = /switch-ports
17192024-11-01T06:52:22.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36825 req_id = 9c78da45-0f1f-4df0-bd9b-86570652af0b response_code = 200 uri = /network-bootstore-config
17202024-11-01T06:52:25.735ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41387
17212024-11-01T06:52:25.735ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41387 req_id = d14d144d-9a89-4c7d-b3bb-f749323b1805 response_code = 200 uri = /baseboard
17222024-11-01T06:52:51.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33812
17232024-11-01T06:52:51.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33812 req_id = 195d5c14-0d5f-4618-8e31-f8d0e6a3d49e response_code = 200 uri = /vpc-routes
17242024-11-01T06:52:51.510ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
17252024-11-01T06:52:51.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33812 req_id = b2c93aab-c12e-4194-979e-ab7e33ac74a6 response_code = 204 uri = /eip-gateways
17262024-11-01T06:52:51.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46408
17272024-11-01T06:52:51.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46408 req_id = 4afc9c72-bfcb-48a9-8bd1-49a19746c152 response_code = 200 uri = /v2p
17282024-11-01T06:52:51.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33812 req_id = d0942b0a-e88e-454f-917c-d08e7ba1b500 response_code = 204 uri = /vpc-routes
17292024-11-01T06:52:51.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55602
17302024-11-01T06:52:51.713ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17312024-11-01T06:52:51.751ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17322024-11-01T06:52:51.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55602 req_id = 9ebc31f4-2a82-4fde-9bfa-adc144a4304a response_code = 204 uri = /switch-ports
17332024-11-01T06:52:51.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55602 req_id = 4979cb84-9ab7-476a-b86e-28ff78b045a5 response_code = 200 uri = /network-bootstore-config
17342024-11-01T06:52:51.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51992
17352024-11-01T06:52:51.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51992 req_id = c1b0cd71-4f50-4616-ab02-1b614ec0aa1e response_code = 200 uri = /vpc-routes
17362024-11-01T06:52:51.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
17372024-11-01T06:52:51.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51992 req_id = 75f062df-3df2-46d2-90d4-b2017ba1fe23 response_code = 204 uri = /eip-gateways
17382024-11-01T06:52:52.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65437
17392024-11-01T06:52:52.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17402024-11-01T06:52:52.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17412024-11-01T06:52:52.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106954 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65437 req_id = 5a0db158-3fee-4ae5-b5f9-8e83fdf12cfd response_code = 204 uri = /switch-ports
17422024-11-01T06:52:52.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60959
17432024-11-01T06:52:52.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65437 req_id = c6247908-9744-4984-800b-be2eb55f1f73 response_code = 200 uri = /network-bootstore-config
17442024-11-01T06:52:52.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60959 req_id = 318d8fc0-b60f-408c-a0b9-6a4405c825bc response_code = 200 uri = /v2p
17452024-11-01T06:52:52.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 438 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51992 req_id = c754ff34-190f-4884-aeda-2b830f48f324 response_code = 204 uri = /vpc-routes
17462024-11-01T06:52:52.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64188
17472024-11-01T06:52:52.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64188 req_id = 20db0724-fa58-49c0-bf10-2f1d5991e08c response_code = 200 uri = /vpc-routes
17482024-11-01T06:52:52.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
17492024-11-01T06:52:52.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64188 req_id = f0014840-7115-4774-9570-077d5de62099 response_code = 204 uri = /eip-gateways
17502024-11-01T06:52:52.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54862
17512024-11-01T06:52:52.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54862 req_id = 8bd1818f-e642-499b-88da-63414274a470 response_code = 200 uri = /v2p
17522024-11-01T06:52:52.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55967
17532024-11-01T06:52:52.440ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17542024-11-01T06:52:52.479ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17552024-11-01T06:52:52.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55967 req_id = b4ac2a94-2b8a-4eee-ba5e-da1cf762c42a response_code = 204 uri = /switch-ports
17562024-11-01T06:52:52.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55967 req_id = 792d146c-34fe-45c9-b9ff-4dc1686a5d22 response_code = 200 uri = /network-bootstore-config
17572024-11-01T06:52:52.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64188 req_id = af982faa-4f6d-4bfc-a9f5-21eb1eec4f4d response_code = 204 uri = /vpc-routes
17582024-11-01T06:52:55.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44898
17592024-11-01T06:52:55.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44898 req_id = bf606ec0-dde9-4353-adc3-55f2e30f95e6 response_code = 200 uri = /baseboard
17602024-11-01T06:53:21.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56107
17612024-11-01T06:53:21.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56107 req_id = 40416108-7c24-4e3b-a41e-f106573a5c89 response_code = 200 uri = /vpc-routes
17622024-11-01T06:53:21.594ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
17632024-11-01T06:53:21.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56107 req_id = 362bc554-8155-4013-a1cc-f8d63b7e01ac response_code = 204 uri = /eip-gateways
17642024-11-01T06:53:21.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56107 req_id = 4f5a3e70-e950-42df-a9ca-7eeba2e8ede9 response_code = 204 uri = /vpc-routes
17652024-11-01T06:53:21.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38034
17662024-11-01T06:53:21.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38034 req_id = 1802789c-35e0-4040-976b-2247b5a939a1 response_code = 200 uri = /v2p
17672024-11-01T06:53:21.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42314
17682024-11-01T06:53:21.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17692024-11-01T06:53:21.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17702024-11-01T06:53:21.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42314 req_id = b36ac859-7d83-4628-98e6-dcb98a05421c response_code = 204 uri = /switch-ports
17712024-11-01T06:53:21.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42314 req_id = dbf20596-d354-4ad1-83c6-fafdbcf55204 response_code = 200 uri = /network-bootstore-config
17722024-11-01T06:53:22.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52522
17732024-11-01T06:53:22.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52522 req_id = 03dbbbd9-2074-40ef-bc4a-71468112252a response_code = 200 uri = /vpc-routes
17742024-11-01T06:53:22.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
17752024-11-01T06:53:22.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52522 req_id = 9420ea73-53bc-41fc-a3f0-492431591c67 response_code = 204 uri = /eip-gateways
17762024-11-01T06:53:22.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52522 req_id = 82a52777-5386-49e1-a767-33bc822393be response_code = 204 uri = /vpc-routes
17772024-11-01T06:53:22.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46783
17782024-11-01T06:53:22.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46783 req_id = 548fdcae-c054-48ab-bc4d-53003d1bc879 response_code = 200 uri = /vpc-routes
17792024-11-01T06:53:22.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48353
17802024-11-01T06:53:22.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48353 req_id = 9890900a-bfff-4c1c-b12b-32da21c3f1ce response_code = 200 uri = /v2p
17812024-11-01T06:53:22.471ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
17822024-11-01T06:53:22.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46783 req_id = 97fad308-d20e-47f1-a3f9-1bc071695ba7 response_code = 204 uri = /eip-gateways
17832024-11-01T06:53:22.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40875
17842024-11-01T06:53:22.561ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17852024-11-01T06:53:22.598ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17862024-11-01T06:53:22.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40875 req_id = 50830650-8fc5-4577-b263-66e15a54c27b response_code = 204 uri = /switch-ports
17872024-11-01T06:53:22.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40875 req_id = 92752cff-557d-4c57-903e-a98d7827f326 response_code = 200 uri = /network-bootstore-config
17882024-11-01T06:53:22.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54226
17892024-11-01T06:53:22.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54226 req_id = 3ed52d0f-6755-4fe5-9ab1-96874ebdd70e response_code = 200 uri = /v2p
17902024-11-01T06:53:22.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46783 req_id = d0326b57-733f-41c8-b13f-599550a41d52 response_code = 204 uri = /vpc-routes
17912024-11-01T06:53:22.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56997
17922024-11-01T06:53:22.877ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17932024-11-01T06:53:22.914ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17942024-11-01T06:53:22.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56997 req_id = 3dca966d-2660-4f3d-bc04-0e4fa6fe34b0 response_code = 204 uri = /switch-ports
17952024-11-01T06:53:22.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56997 req_id = 149d2be2-9045-4c5d-849f-39e46c0c773f response_code = 200 uri = /network-bootstore-config
17962024-11-01T06:53:25.800ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64347
17972024-11-01T06:53:25.800ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64347 req_id = eb068f1d-b097-426a-95c5-dce8e960a4bf response_code = 200 uri = /baseboard
17982024-11-01T06:53:51.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40946
17992024-11-01T06:53:51.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40946 req_id = 3ec2c669-e3b9-4928-971f-1d0eabdadf59 response_code = 200 uri = /vpc-routes
18002024-11-01T06:53:51.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55841
18012024-11-01T06:53:51.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18022024-11-01T06:53:51.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18032024-11-01T06:53:51.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91488 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55841 req_id = 6f6d5933-1f5e-48f6-9adf-8cf48a0aa3b1 response_code = 204 uri = /switch-ports
18042024-11-01T06:53:51.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38413
18052024-11-01T06:53:51.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55841 req_id = 7799c11e-23be-4ef2-97bd-ff727e108fd4 response_code = 200 uri = /network-bootstore-config
18062024-11-01T06:53:51.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38413 req_id = 3769bc34-e0b2-4c37-850a-732023203f22 response_code = 200 uri = /v2p
18072024-11-01T06:53:51.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18082024-11-01T06:53:51.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40946 req_id = 25ba399e-38ad-404e-b2c2-cab9b9b23e70 response_code = 204 uri = /eip-gateways
18092024-11-01T06:53:51.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40946 req_id = 4a5434ec-574d-4694-a732-981b81e9ab4e response_code = 204 uri = /vpc-routes
18102024-11-01T06:53:51.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45320
18112024-11-01T06:53:51.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45320 req_id = f8c960f8-57b1-490c-84a4-e9dbe7226e5e response_code = 200 uri = /vpc-routes
18122024-11-01T06:53:51.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18132024-11-01T06:53:51.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45320 req_id = 786b5222-e10f-4704-be9e-e3cc013a3323 response_code = 204 uri = /eip-gateways
18142024-11-01T06:53:51.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45320 req_id = b6cc8df3-18a8-476d-9636-e81fbeb50ce4 response_code = 204 uri = /vpc-routes
18152024-11-01T06:53:52.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33387
18162024-11-01T06:53:52.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18172024-11-01T06:53:52.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18182024-11-01T06:53:52.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33387 req_id = 51602577-9b74-45c9-8d4d-532efaf72d3c response_code = 204 uri = /switch-ports
18192024-11-01T06:53:52.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63399
18202024-11-01T06:53:52.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63399 req_id = d34646a3-f7b4-4757-bdc2-9df3d59ca009 response_code = 200 uri = /v2p
18212024-11-01T06:53:52.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33387 req_id = 3fbb819a-9a4b-4543-91fe-88634663e783 response_code = 200 uri = /network-bootstore-config
18222024-11-01T06:53:52.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47471
18232024-11-01T06:53:52.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47471 req_id = c3e49e75-42fc-4d6b-a91e-4e6be188c646 response_code = 200 uri = /vpc-routes
18242024-11-01T06:53:52.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18252024-11-01T06:53:52.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47471 req_id = 9facf9fd-1f18-43ed-a963-cf2a88096513 response_code = 204 uri = /eip-gateways
18262024-11-01T06:53:52.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52699
18272024-11-01T06:53:52.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52699 req_id = c940122b-f773-45fd-a839-164ef721cf61 response_code = 200 uri = /v2p
18282024-11-01T06:53:52.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61163
18292024-11-01T06:53:52.489ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18302024-11-01T06:53:52.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18312024-11-01T06:53:52.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86882 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61163 req_id = 827385ef-e4bc-4ae7-8525-022062eaba46 response_code = 204 uri = /switch-ports
18322024-11-01T06:53:52.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61163 req_id = a3e707aa-57e6-422c-82d9-3833ba6d3174 response_code = 200 uri = /network-bootstore-config
18332024-11-01T06:53:52.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47471 req_id = 8d1c88a6-6dc7-4b6b-b6e5-83d8df3c3d9f response_code = 204 uri = /vpc-routes
18342024-11-01T06:53:55.835ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39944
18352024-11-01T06:53:55.835ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39944 req_id = 3641b0f1-d588-41fd-97f0-89c1ff407c57 response_code = 200 uri = /baseboard
18362024-11-01T06:54:19.399ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18372024-11-01T06:54:21.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47408
18382024-11-01T06:54:21.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47408 req_id = f4930fe8-5769-454a-8ccb-c0c63a28ac8d response_code = 200 uri = /vpc-routes
18392024-11-01T06:54:21.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18402024-11-01T06:54:21.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47408 req_id = 247df74e-a2ef-4478-a8e0-846c0ed40442 response_code = 204 uri = /eip-gateways
18412024-11-01T06:54:21.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47408 req_id = 1e57ba2b-7208-48a1-8060-3527e606243e response_code = 204 uri = /vpc-routes
18422024-11-01T06:54:21.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64201
18432024-11-01T06:54:21.914ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18442024-11-01T06:54:21.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18452024-11-01T06:54:22.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101573 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64201 req_id = f6206c4f-a381-4f51-bd5c-b4efb6f6aa52 response_code = 204 uri = /switch-ports
18462024-11-01T06:54:22.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64921
18472024-11-01T06:54:22.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64201 req_id = 81b51c8d-f108-43d0-a9ff-cf28ca6b7aa4 response_code = 200 uri = /network-bootstore-config
18482024-11-01T06:54:22.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64921 req_id = 58cd1773-d996-4ddd-acf4-1c125df65d7e response_code = 200 uri = /v2p
18492024-11-01T06:54:22.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48589
18502024-11-01T06:54:22.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48589 req_id = ea5d10ad-56bd-4e5e-9076-61a8698996ff response_code = 200 uri = /vpc-routes
18512024-11-01T06:54:22.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18522024-11-01T06:54:22.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48589 req_id = dbbfc1d6-c8df-4db8-8713-d47648c59c19 response_code = 204 uri = /eip-gateways
18532024-11-01T06:54:22.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48589 req_id = 14d80898-89d9-4a30-944d-7faa761050e0 response_code = 204 uri = /vpc-routes
18542024-11-01T06:54:22.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63721
18552024-11-01T06:54:22.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63721 req_id = 45abbaed-3ba7-44f2-8a7c-383403e71812 response_code = 200 uri = /v2p
18562024-11-01T06:54:22.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47580
18572024-11-01T06:54:22.419ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18582024-11-01T06:54:22.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18592024-11-01T06:54:22.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47580 req_id = 199c8226-c5da-4a1f-b9ac-9b3503daf70e response_code = 204 uri = /switch-ports
18602024-11-01T06:54:22.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50884
18612024-11-01T06:54:22.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50884 req_id = 3a09859a-5325-471e-b9c5-6a1220573018 response_code = 200 uri = /v2p
18622024-11-01T06:54:22.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47580 req_id = 9a090ade-bd23-426c-a285-a62124751742 response_code = 200 uri = /network-bootstore-config
18632024-11-01T06:54:22.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61053
18642024-11-01T06:54:22.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61053 req_id = 722e7c9b-3643-4ab1-8ac4-b167055cd2c3 response_code = 200 uri = /vpc-routes
18652024-11-01T06:54:22.660ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18662024-11-01T06:54:22.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61053 req_id = 0fe852cd-38b3-4530-b200-bea120f1cf7c response_code = 204 uri = /eip-gateways
18672024-11-01T06:54:22.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61053 req_id = 255aa71b-4a6b-448d-887c-3b5ccb271c75 response_code = 204 uri = /vpc-routes
18682024-11-01T06:54:22.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62580
18692024-11-01T06:54:22.851ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18702024-11-01T06:54:22.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18712024-11-01T06:54:22.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88272 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62580 req_id = c92fdf32-d2a4-436c-836d-565eb3f168b1 response_code = 204 uri = /switch-ports
18722024-11-01T06:54:22.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62580 req_id = 3cee7846-2008-4489-9fbe-1f4efb7b457f response_code = 200 uri = /network-bootstore-config
18732024-11-01T06:54:25.867ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38509
18742024-11-01T06:54:25.867ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38509 req_id = 8a3e9436-b4d2-4e5d-b1f1-b528029c1610 response_code = 200 uri = /baseboard
18752024-11-01T06:54:51.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39259
18762024-11-01T06:54:51.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39259 req_id = bce58145-fb50-4c0b-a003-d8d2d76599ef response_code = 200 uri = /vpc-routes
18772024-11-01T06:54:51.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18782024-11-01T06:54:51.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39259 req_id = aa513d65-156e-4ac6-954d-e270a4a1c699 response_code = 204 uri = /eip-gateways
18792024-11-01T06:54:51.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50250
18802024-11-01T06:54:51.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50250 req_id = ca5d72e2-1bb7-4a70-86ea-9e2b4499924c response_code = 200 uri = /v2p
18812024-11-01T06:54:51.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39259 req_id = 048ea55f-44b2-4602-998c-8ac9aa2d6772 response_code = 204 uri = /vpc-routes
18822024-11-01T06:54:51.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36547
18832024-11-01T06:54:51.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18842024-11-01T06:54:51.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18852024-11-01T06:54:51.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36547 req_id = 55065f61-c32f-47ae-914c-f44fbd9b4358 response_code = 204 uri = /switch-ports
18862024-11-01T06:54:51.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36547 req_id = 421f5892-5a35-4bff-825e-0b290718f74c response_code = 200 uri = /network-bootstore-config
18872024-11-01T06:54:51.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47125
18882024-11-01T06:54:51.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47125 req_id = 0979ee1f-ad4a-479e-9d3f-e4289d8fdf1a response_code = 200 uri = /vpc-routes
18892024-11-01T06:54:51.945ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
18902024-11-01T06:54:51.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47125 req_id = b13e50a2-ea94-4635-8fb7-c9a4f68764ff response_code = 204 uri = /eip-gateways
18912024-11-01T06:54:51.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47125 req_id = 23febfe7-453d-46fc-9a2a-ccbe51c66989 response_code = 204 uri = /vpc-routes
18922024-11-01T06:54:52.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46369
18932024-11-01T06:54:52.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46369 req_id = 218be127-ef04-4f28-8e77-60eff11d9bf3 response_code = 200 uri = /v2p
18942024-11-01T06:54:52.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58504
18952024-11-01T06:54:52.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18962024-11-01T06:54:52.173ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18972024-11-01T06:54:52.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58504 req_id = e6ffb159-71f4-40f3-aff4-e6de485455ad response_code = 204 uri = /switch-ports
18982024-11-01T06:54:52.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58504 req_id = 83002be1-df87-4137-874d-2b2fafaca3da response_code = 200 uri = /network-bootstore-config
18992024-11-01T06:54:52.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36088
19002024-11-01T06:54:52.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36088 req_id = ec1017ad-8b41-4f44-8e3e-16f58b490d79 response_code = 200 uri = /vpc-routes
19012024-11-01T06:54:52.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43279
19022024-11-01T06:54:52.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43279 req_id = 7ed54adc-a789-4393-b3e4-070547f13229 response_code = 200 uri = /v2p
19032024-11-01T06:54:52.348ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19042024-11-01T06:54:52.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36088 req_id = 5f51f7f0-486d-46f1-a51d-6c92fa633c20 response_code = 204 uri = /eip-gateways
19052024-11-01T06:54:52.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36088 req_id = b1e95ffc-b757-4a36-b700-e2fbc5fa21da response_code = 204 uri = /vpc-routes
19062024-11-01T06:54:52.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50859
19072024-11-01T06:54:52.444ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19082024-11-01T06:54:52.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19092024-11-01T06:54:52.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50859 req_id = b6383c51-770e-436d-a5e2-af1f52e8d6a4 response_code = 204 uri = /switch-ports
19102024-11-01T06:54:52.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50859 req_id = 51c171b7-01e1-43da-bb5c-e88d1616968f response_code = 200 uri = /network-bootstore-config
19112024-11-01T06:54:55.900ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34205
19122024-11-01T06:54:55.900ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34205 req_id = 40decc2e-d487-4f22-bedd-a573ec671801 response_code = 200 uri = /baseboard
19132024-11-01T06:55:21.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48888
19142024-11-01T06:55:21.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48888 req_id = 373ed80f-fb4b-4ee7-ba85-7376d74c4815 response_code = 200 uri = /vpc-routes
19152024-11-01T06:55:21.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44510
19162024-11-01T06:55:21.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44510 req_id = c0a8c894-bce9-4f94-a7ee-79a6cd5a1bf2 response_code = 200 uri = /v2p
19172024-11-01T06:55:21.652ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19182024-11-01T06:55:21.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48888 req_id = c030d296-6b04-4be9-a5ba-7533c170b3da response_code = 204 uri = /eip-gateways
19192024-11-01T06:55:21.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48888 req_id = 3ceb44d3-770a-4092-b150-f75ac1a8aef2 response_code = 204 uri = /vpc-routes
19202024-11-01T06:55:21.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52449
19212024-11-01T06:55:21.833ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19222024-11-01T06:55:21.877ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19232024-11-01T06:55:21.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52449 req_id = afcad0a0-445c-496e-b628-6e702a45eb75 response_code = 204 uri = /switch-ports
19242024-11-01T06:55:21.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52449 req_id = 1c42137f-b7f9-42dd-80c7-056f58c79a6e response_code = 200 uri = /network-bootstore-config
19252024-11-01T06:55:21.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53217
19262024-11-01T06:55:21.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53217 req_id = 1985280a-303e-4491-8cd7-cff70c3020b8 response_code = 200 uri = /vpc-routes
19272024-11-01T06:55:22.041ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19282024-11-01T06:55:22.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53217 req_id = d99ce546-98b7-4f19-9e01-7ead44eb6814 response_code = 204 uri = /eip-gateways
19292024-11-01T06:55:22.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53217 req_id = 77b661e1-c14a-45d7-aeae-519cf2958841 response_code = 204 uri = /vpc-routes
19302024-11-01T06:55:22.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41493
19312024-11-01T06:55:22.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41493 req_id = 58765fd6-888b-436d-812c-32ca672a8dfe response_code = 200 uri = /v2p
19322024-11-01T06:55:22.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52835
19332024-11-01T06:55:22.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19342024-11-01T06:55:22.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19352024-11-01T06:55:22.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100361 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52835 req_id = efdfe30c-aa9a-48eb-9b67-8a366245a3f7 response_code = 204 uri = /switch-ports
19362024-11-01T06:55:22.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52835 req_id = 3e6a3f90-c8df-4e6c-a0bf-1894edc00f55 response_code = 200 uri = /network-bootstore-config
19372024-11-01T06:55:22.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52461
19382024-11-01T06:55:22.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52461 req_id = a39e20b7-4df5-487c-b41f-50a1c769614e response_code = 200 uri = /vpc-routes
19392024-11-01T06:55:22.442ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19402024-11-01T06:55:22.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52461 req_id = ddbc9f0d-96fd-41d6-a112-b89edd0574b5 response_code = 204 uri = /eip-gateways
19412024-11-01T06:55:22.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45364
19422024-11-01T06:55:22.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45364 req_id = a3c03acd-ad04-4b8d-abff-ef87b58d061c response_code = 200 uri = /v2p
19432024-11-01T06:55:22.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52461 req_id = 94f87d05-7e8e-4889-83d5-63778ec224e1 response_code = 204 uri = /vpc-routes
19442024-11-01T06:55:22.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40381
19452024-11-01T06:55:22.668ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19462024-11-01T06:55:22.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19472024-11-01T06:55:22.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40381 req_id = 29790356-1277-4e28-9318-391a579e4426 response_code = 204 uri = /switch-ports
19482024-11-01T06:55:22.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40381 req_id = 23114c46-703f-40af-b940-1e500d326b8b response_code = 200 uri = /network-bootstore-config
19492024-11-01T06:55:25.933ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64166
19502024-11-01T06:55:25.933ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64166 req_id = 97af0f79-b9a5-4800-9ffb-46678fe47019 response_code = 200 uri = /baseboard
19512024-11-01T06:55:51.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34566
19522024-11-01T06:55:51.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34566 req_id = 4c65b66d-1dc1-49d0-9ad6-89399ee527f0 response_code = 200 uri = /vpc-routes
19532024-11-01T06:55:51.501ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19542024-11-01T06:55:51.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34566 req_id = 8e55dba5-a2d2-46bd-a093-34f2f80c7dee response_code = 204 uri = /eip-gateways
19552024-11-01T06:55:51.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34566 req_id = 3c6fa2f2-7c23-401a-a77c-4de15d149eba response_code = 204 uri = /vpc-routes
19562024-11-01T06:55:51.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34100
19572024-11-01T06:55:51.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34100 req_id = 4fa1a40d-0dfb-4fb8-9d4a-8865772c1ab4 response_code = 200 uri = /v2p
19582024-11-01T06:55:51.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33189
19592024-11-01T06:55:51.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19602024-11-01T06:55:51.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19612024-11-01T06:55:51.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33189 req_id = c382b313-e770-4256-a288-562f7a7d89d6 response_code = 204 uri = /switch-ports
19622024-11-01T06:55:51.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33189 req_id = 9bd15cb6-1010-43e9-af94-5c2f049982c2 response_code = 200 uri = /network-bootstore-config
19632024-11-01T06:55:51.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47736
19642024-11-01T06:55:51.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47736 req_id = 09f80bfa-b84c-4d0f-9150-9b814548c58b response_code = 200 uri = /vpc-routes
19652024-11-01T06:55:51.969ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19662024-11-01T06:55:51.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47736 req_id = a1ca43a3-0edc-4193-9586-ffff67e7ee9b response_code = 204 uri = /eip-gateways
19672024-11-01T06:55:51.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47736 req_id = 6d1b3027-b85f-4e27-8de2-828cb42cbb15 response_code = 204 uri = /vpc-routes
19682024-11-01T06:55:52.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59197
19692024-11-01T06:55:52.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59197 req_id = e415b28f-547a-4d6d-b394-ad4eb9b750a2 response_code = 200 uri = /v2p
19702024-11-01T06:55:52.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45315
19712024-11-01T06:55:52.014ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19722024-11-01T06:55:52.054ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19732024-11-01T06:55:52.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97648 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45315 req_id = 4e1c7e01-4be3-4cfc-b9f6-67240739108d response_code = 204 uri = /switch-ports
19742024-11-01T06:55:52.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45315 req_id = f6000819-a739-4ae5-ac6f-9a3537076eb0 response_code = 200 uri = /network-bootstore-config
19752024-11-01T06:55:52.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61151
19762024-11-01T06:55:52.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61151 req_id = 8c4520ea-7533-42cb-bb50-e0b24d59a9fb response_code = 200 uri = /vpc-routes
19772024-11-01T06:55:52.366ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19782024-11-01T06:55:52.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61151 req_id = 9a021235-3d3b-4b79-9c88-2d4fc85039a5 response_code = 204 uri = /eip-gateways
19792024-11-01T06:55:52.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61151 req_id = 9d217592-56cf-42cb-b85f-30c3267c5dda response_code = 204 uri = /vpc-routes
19802024-11-01T06:55:52.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34584
19812024-11-01T06:55:52.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34584 req_id = fc58ef65-1c36-4521-9e34-2742590e2132 response_code = 200 uri = /v2p
19822024-11-01T06:55:52.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57274
19832024-11-01T06:55:52.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19842024-11-01T06:55:52.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19852024-11-01T06:55:52.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98927 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57274 req_id = a99afd0a-6d94-4a39-93e1-383dad97410e response_code = 204 uri = /switch-ports
19862024-11-01T06:55:52.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57274 req_id = 3ff41992-6270-45fe-9cc3-b2eb1b1332ba response_code = 200 uri = /network-bootstore-config
19872024-11-01T06:55:55.968ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59309
19882024-11-01T06:55:55.968ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59309 req_id = c93cf60d-7822-44f3-8e6e-38c20869f830 response_code = 200 uri = /baseboard
19892024-11-01T06:56:21.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34039
19902024-11-01T06:56:21.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34039 req_id = d89fe0dd-943d-42d4-b5d6-1f597aaf2345 response_code = 200 uri = /vpc-routes
19912024-11-01T06:56:21.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
19922024-11-01T06:56:21.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34039 req_id = 4b06103a-c812-474f-a6fc-9cce80ba7805 response_code = 204 uri = /eip-gateways
19932024-11-01T06:56:21.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34039 req_id = 1f6eeff3-6151-41e5-a42a-6d299c0cee31 response_code = 204 uri = /vpc-routes
19942024-11-01T06:56:21.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59218
19952024-11-01T06:56:21.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59218 req_id = 493312c2-a9ee-4103-afd2-2f8a8cfe402d response_code = 200 uri = /v2p
19962024-11-01T06:56:21.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53468
19972024-11-01T06:56:21.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19982024-11-01T06:56:21.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19992024-11-01T06:56:22.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53468 req_id = 93876566-33d9-43e5-8dfe-1e4c0c1257c9 response_code = 204 uri = /switch-ports
20002024-11-01T06:56:22.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56058
20012024-11-01T06:56:22.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53468 req_id = 93a78cfc-1e21-42df-958b-c4f842f629a4 response_code = 200 uri = /network-bootstore-config
20022024-11-01T06:56:22.043ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20032024-11-01T06:56:22.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20042024-11-01T06:56:22.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20052024-11-01T06:56:22.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20062024-11-01T06:56:22.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20072024-11-01T06:56:22.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20082024-11-01T06:56:22.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20092024-11-01T06:56:22.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56058 req_id = 63f41075-2008-4842-bda1-455e8bf1260c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20102024-11-01T06:56:22.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39885
20112024-11-01T06:56:22.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39885 req_id = 9a5ab862-1272-4ff4-bb77-56eeb5e798e0 response_code = 200 uri = /v2p
20122024-11-01T06:56:22.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41368
20132024-11-01T06:56:22.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41368 req_id = 59fb0f9a-ee82-4e63-90ae-3c5de6ebd8d5 response_code = 200 uri = /vpc-routes
20142024-11-01T06:56:22.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43772
20152024-11-01T06:56:22.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43772 req_id = 7f331464-754b-4c9f-8a16-1d8ae16ae5b7 response_code = 200 uri = /vpc-routes
20162024-11-01T06:56:22.461ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
20172024-11-01T06:56:22.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41368 req_id = e75cf87a-4f8f-44f7-a3c0-47336b36e6f1 response_code = 204 uri = /eip-gateways
20182024-11-01T06:56:22.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41368 req_id = f84d2e02-f796-418a-a512-c755bb529244 response_code = 204 uri = /vpc-routes
20192024-11-01T06:56:22.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
20202024-11-01T06:56:22.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43772 req_id = c71a6891-31be-4a0f-9700-545e4adc5613 response_code = 204 uri = /eip-gateways
20212024-11-01T06:56:22.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43772 req_id = 57792c3d-8dfc-4504-baf9-f094e9290832 response_code = 204 uri = /vpc-routes
20222024-11-01T06:56:22.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59130
20232024-11-01T06:56:22.539ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20242024-11-01T06:56:22.584ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20252024-11-01T06:56:22.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59130 req_id = 195b4919-1453-41c5-b6a4-8b1d3a94175c response_code = 204 uri = /switch-ports
20262024-11-01T06:56:22.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58716
20272024-11-01T06:56:22.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58716 req_id = 035f28e6-d6e8-4078-9eed-12cf0ee460d8 response_code = 200 uri = /v2p
20282024-11-01T06:56:22.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59130 req_id = 7a34eb63-a166-45ce-b9d2-5bd311f552a7 response_code = 200 uri = /network-bootstore-config
20292024-11-01T06:56:22.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39234
20302024-11-01T06:56:22.666ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20312024-11-01T06:56:22.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20322024-11-01T06:56:22.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100712 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39234 req_id = 29f9a47c-f32d-4bf5-8429-1f5d129cfe0c response_code = 204 uri = /switch-ports
20332024-11-01T06:56:22.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39234 req_id = a0e564f3-adc0-4a7e-a080-dfa0025a7c74 response_code = 200 uri = /network-bootstore-config
20342024-11-01T06:56:22.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45946
20352024-11-01T06:56:22.838ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20362024-11-01T06:56:22.838ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20372024-11-01T06:56:22.838ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20382024-11-01T06:56:22.838ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20392024-11-01T06:56:22.838ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20402024-11-01T06:56:22.838ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20412024-11-01T06:56:22.838ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20422024-11-01T06:56:22.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45946 req_id = 83c36614-a559-41e2-a459-0ca2775b4261 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20432024-11-01T06:56:22.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60256
20442024-11-01T06:56:22.920ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20452024-11-01T06:56:22.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20462024-11-01T06:56:22.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20472024-11-01T06:56:22.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20482024-11-01T06:56:22.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20492024-11-01T06:56:22.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20502024-11-01T06:56:22.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20512024-11-01T06:56:22.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60256 req_id = 173c6371-ac3a-4d2b-b31f-a2276ac4fa8e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20522024-11-01T06:56:26.003ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44644
20532024-11-01T06:56:26.003ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44644 req_id = f0fe775f-ba11-4492-b37d-5b3e597701e5 response_code = 200 uri = /baseboard
20542024-11-01T06:56:51.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59144
20552024-11-01T06:56:51.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59144 req_id = a1dcb36a-7fac-4cb0-bb34-5e9f0f2bffaa response_code = 200 uri = /vpc-routes
20562024-11-01T06:56:51.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52724
20572024-11-01T06:56:51.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52724 req_id = d620448d-336f-4121-b5b5-92b707639ddf response_code = 200 uri = /v2p
20582024-11-01T06:56:51.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
20592024-11-01T06:56:51.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59144 req_id = 48fd3691-e43c-4357-b243-b8325fd3af10 response_code = 204 uri = /eip-gateways
20602024-11-01T06:56:51.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59144 req_id = 7786b4c1-47da-422e-b516-c264240996e5 response_code = 204 uri = /vpc-routes
20612024-11-01T06:56:51.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48974
20622024-11-01T06:56:51.597ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20632024-11-01T06:56:51.638ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20642024-11-01T06:56:51.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48974 req_id = 802dc4b6-74c1-4439-b945-980c824b92ac response_code = 204 uri = /switch-ports
20652024-11-01T06:56:51.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48974 req_id = 7bcb8904-ccf7-4403-80a1-95370535b0b1 response_code = 200 uri = /network-bootstore-config
20662024-11-01T06:56:52.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56178
20672024-11-01T06:56:52.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56178 req_id = 18cc1569-5c9a-483a-ab11-dd0ddb02c1cf response_code = 200 uri = /vpc-routes
20682024-11-01T06:56:52.085ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
20692024-11-01T06:56:52.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56178 req_id = f5fb5ccd-4db6-404d-9a65-213f6e4b539f response_code = 204 uri = /eip-gateways
20702024-11-01T06:56:52.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56178 req_id = cd101ae5-c729-4d45-9bbe-b4d86983f3ff response_code = 204 uri = /vpc-routes
20712024-11-01T06:56:52.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47657
20722024-11-01T06:56:52.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47657 req_id = cff5e741-6e8a-472d-a836-aefa215b16d6 response_code = 200 uri = /v2p
20732024-11-01T06:56:52.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49850
20742024-11-01T06:56:52.168ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20752024-11-01T06:56:52.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20762024-11-01T06:56:52.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49850 req_id = 86d27d8c-bcc4-4ccb-8f70-4a4e2cdc421a response_code = 204 uri = /switch-ports
20772024-11-01T06:56:52.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49850 req_id = 8a397690-e95c-4a7d-9d34-0bcc1af867f0 response_code = 200 uri = /network-bootstore-config
20782024-11-01T06:56:52.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53597
20792024-11-01T06:56:52.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53597 req_id = fe163b1c-c5bc-48fa-92ed-d49fe13339aa response_code = 200 uri = /vpc-routes
20802024-11-01T06:56:52.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
20812024-11-01T06:56:52.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53597 req_id = 9ced5288-ab48-4421-bbd2-6f52bbe01170 response_code = 204 uri = /eip-gateways
20822024-11-01T06:56:52.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53597 req_id = 66215b50-f401-474d-9f31-3e680d44b966 response_code = 204 uri = /vpc-routes
20832024-11-01T06:56:52.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37134
20842024-11-01T06:56:52.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37134 req_id = 471283e2-5687-4402-85f1-fca05bbda1a4 response_code = 200 uri = /v2p
20852024-11-01T06:56:52.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51694
20862024-11-01T06:56:52.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20872024-11-01T06:56:52.531ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20882024-11-01T06:56:52.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51694 req_id = c997bceb-4b50-4df3-9c3e-0a3f002d075f response_code = 204 uri = /switch-ports
20892024-11-01T06:56:52.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51694 req_id = f213bc0d-05e8-4044-a973-0d490aadc5de response_code = 200 uri = /network-bootstore-config
20902024-11-01T06:56:56.036ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54728
20912024-11-01T06:56:56.036ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54728 req_id = 9d560236-181b-49ce-bae6-98eefcbe0c05 response_code = 200 uri = /baseboard
20922024-11-01T06:57:21.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57162
20932024-11-01T06:57:21.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57162 req_id = 8ff77314-e17c-466c-9e19-ea80e5839506 response_code = 200 uri = /vpc-routes
20942024-11-01T06:57:21.547ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
20952024-11-01T06:57:21.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57162 req_id = 70e0049f-30e5-471e-846c-29d455dd6b7e response_code = 204 uri = /eip-gateways
20962024-11-01T06:57:21.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57162 req_id = 4368e712-5290-496f-b61a-838296c8e26c response_code = 204 uri = /vpc-routes
20972024-11-01T06:57:21.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32848
20982024-11-01T06:57:21.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32848 req_id = c4ba711a-dc38-4497-b862-05f543dfbacd response_code = 200 uri = /v2p
20992024-11-01T06:57:21.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46426
21002024-11-01T06:57:21.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21012024-11-01T06:57:21.855ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21022024-11-01T06:57:21.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46426 req_id = 44fbc443-60cc-44a0-ba5d-513cb5459aab response_code = 204 uri = /switch-ports
21032024-11-01T06:57:21.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46426 req_id = 828365f8-f827-402b-9971-5cb0905716b5 response_code = 200 uri = /network-bootstore-config
21042024-11-01T06:57:22.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64526
21052024-11-01T06:57:22.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64526 req_id = 35199951-9498-4b31-91da-b413af8bbc1f response_code = 200 uri = /v2p
21062024-11-01T06:57:22.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36432
21072024-11-01T06:57:22.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36432 req_id = e1b8bd75-8dec-48c4-8064-b4c3320de16a response_code = 200 uri = /vpc-routes
21082024-11-01T06:57:22.201ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21092024-11-01T06:57:22.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36432 req_id = 87c83bb6-213f-42ff-a9c6-ebe03a7f1258 response_code = 204 uri = /eip-gateways
21102024-11-01T06:57:22.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36432 req_id = dbd464c4-6723-446a-a132-c3031531e06c response_code = 204 uri = /vpc-routes
21112024-11-01T06:57:22.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61164
21122024-11-01T06:57:22.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21132024-11-01T06:57:22.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21142024-11-01T06:57:22.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109585 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61164 req_id = c9e6ee31-deab-42d4-8c6d-6984e9bdb44a response_code = 204 uri = /switch-ports
21152024-11-01T06:57:22.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51951
21162024-11-01T06:57:22.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51951 req_id = c07ad79d-09c2-40e8-8fc6-e51aefd7dde0 response_code = 200 uri = /vpc-routes
21172024-11-01T06:57:22.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61164 req_id = c8c2fdc9-3b9f-4fa0-8602-1e1772f124dd response_code = 200 uri = /network-bootstore-config
21182024-11-01T06:57:22.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21192024-11-01T06:57:22.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51951 req_id = ac0236ee-880a-455d-9f92-d3a1e2a0ea43 response_code = 204 uri = /eip-gateways
21202024-11-01T06:57:22.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33834
21212024-11-01T06:57:22.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33834 req_id = e8802b31-9320-4579-8a95-a0be2cbe2575 response_code = 200 uri = /v2p
21222024-11-01T06:57:22.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51951 req_id = 47967fee-683c-464e-af90-a363093ecf5e response_code = 204 uri = /vpc-routes
21232024-11-01T06:57:22.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54518
21242024-11-01T06:57:22.694ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21252024-11-01T06:57:22.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21262024-11-01T06:57:22.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54518 req_id = 3c30fc2e-4b57-460e-9bf0-2f6df5ad8d56 response_code = 204 uri = /switch-ports
21272024-11-01T06:57:22.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54518 req_id = 777a054d-dfd8-458c-a156-3e77cb078635 response_code = 200 uri = /network-bootstore-config
21282024-11-01T06:57:26.069ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62453
21292024-11-01T06:57:26.069ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62453 req_id = 047b0464-a75c-42ba-962a-544e0d5e58bb response_code = 200 uri = /baseboard
21302024-11-01T06:57:51.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33454
21312024-11-01T06:57:51.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33454 req_id = 10d3a963-dcab-4d8d-ae3d-6a4b65a1995e response_code = 200 uri = /vpc-routes
21322024-11-01T06:57:51.500ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21332024-11-01T06:57:51.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33454 req_id = 2543898b-519d-461a-9f5b-914f5e788eac response_code = 204 uri = /eip-gateways
21342024-11-01T06:57:51.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33454 req_id = 99aedb35-2295-41cd-833c-e12fbe11dcb3 response_code = 204 uri = /vpc-routes
21352024-11-01T06:57:51.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44947
21362024-11-01T06:57:51.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44947 req_id = 3a0905ea-a535-4cf6-b24d-58ee18a75027 response_code = 200 uri = /v2p
21372024-11-01T06:57:51.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39878
21382024-11-01T06:57:51.588ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21392024-11-01T06:57:51.625ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21402024-11-01T06:57:51.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94013 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39878 req_id = 5d26c5bd-ea90-4fff-9c86-13fa4d0c0677 response_code = 204 uri = /switch-ports
21412024-11-01T06:57:51.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39878 req_id = 142a8bd8-aae2-4b8c-b7a3-f53aa74bcb9a response_code = 200 uri = /network-bootstore-config
21422024-11-01T06:57:52.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57744
21432024-11-01T06:57:52.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57744 req_id = 54e854e2-a7cc-4a0a-8b33-c6dd0b080fc3 response_code = 200 uri = /vpc-routes
21442024-11-01T06:57:52.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21452024-11-01T06:57:52.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57744 req_id = f1816b1f-5872-4972-98c8-c65f63e11bd6 response_code = 204 uri = /eip-gateways
21462024-11-01T06:57:52.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57744 req_id = 57faed4f-cbbf-4b5a-b65e-7e3cad688e0e response_code = 204 uri = /vpc-routes
21472024-11-01T06:57:52.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45022
21482024-11-01T06:57:52.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45022 req_id = e337c030-0517-4032-b52d-3680acd60438 response_code = 200 uri = /v2p
21492024-11-01T06:57:52.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53717
21502024-11-01T06:57:52.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21512024-11-01T06:57:52.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21522024-11-01T06:57:52.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53717 req_id = 15e573ed-49d2-479a-9ebe-4cb3da091e22 response_code = 204 uri = /switch-ports
21532024-11-01T06:57:52.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53717 req_id = 94a5d6fa-501f-4358-998e-0a4be56f9e06 response_code = 200 uri = /network-bootstore-config
21542024-11-01T06:57:52.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38631
21552024-11-01T06:57:52.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38631 req_id = cc806460-78e6-4e42-a90e-7f6b52f52af4 response_code = 200 uri = /vpc-routes
21562024-11-01T06:57:52.447ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21572024-11-01T06:57:52.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38631 req_id = c7b3736d-cac5-400f-bd3c-1a472a3a0b8b response_code = 204 uri = /eip-gateways
21582024-11-01T06:57:52.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38631 req_id = f03d89d3-4087-40cf-81c3-77fd78026a8a response_code = 204 uri = /vpc-routes
21592024-11-01T06:57:52.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52566
21602024-11-01T06:57:52.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52566 req_id = 69909d83-6bfd-41b0-866f-47b32e769a07 response_code = 200 uri = /v2p
21612024-11-01T06:57:52.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34362
21622024-11-01T06:57:52.506ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21632024-11-01T06:57:52.547ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21642024-11-01T06:57:52.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34362 req_id = cf46f104-cc1b-4a96-8351-d10f54401a86 response_code = 204 uri = /switch-ports
21652024-11-01T06:57:52.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34362 req_id = 7f2cdb02-6562-407c-a270-3147a842da8b response_code = 200 uri = /network-bootstore-config
21662024-11-01T06:57:56.102ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49948
21672024-11-01T06:57:56.102ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49948 req_id = 9f6eedb3-7afe-4d8e-a2e4-8f57a720faf7 response_code = 200 uri = /baseboard
21682024-11-01T06:58:21.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52451
21692024-11-01T06:58:21.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52451 req_id = bc1e6b4c-eed9-4bb7-8d90-7167e91b21df response_code = 200 uri = /vpc-routes
21702024-11-01T06:58:21.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21712024-11-01T06:58:21.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52451 req_id = 0f2a12d9-d11e-43b4-b7bc-c3c8608cc869 response_code = 204 uri = /eip-gateways
21722024-11-01T06:58:21.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52451 req_id = 49a397b8-57f1-461c-a3f2-58a7033c507a response_code = 204 uri = /vpc-routes
21732024-11-01T06:58:21.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60047
21742024-11-01T06:58:21.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60047 req_id = 9bcf6aaf-aa77-4808-b29e-d68ea9f19952 response_code = 200 uri = /v2p
21752024-11-01T06:58:21.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62377
21762024-11-01T06:58:21.801ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21772024-11-01T06:58:21.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21782024-11-01T06:58:21.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118662 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62377 req_id = 542f6daa-a25c-44a5-be8c-2ad9fc8eb611 response_code = 204 uri = /switch-ports
21792024-11-01T06:58:21.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62377 req_id = 3a07e308-135a-40c7-8128-3023519d9b17 response_code = 200 uri = /network-bootstore-config
21802024-11-01T06:58:22.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38663
21812024-11-01T06:58:22.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38663 req_id = f6bd0923-2f4f-4c9e-b4f8-bd7ba8d9b573 response_code = 200 uri = /v2p
21822024-11-01T06:58:22.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61379
21832024-11-01T06:58:22.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61379 req_id = be670d06-f782-48cb-a485-3eb68d7f3bbc response_code = 200 uri = /vpc-routes
21842024-11-01T06:58:22.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21852024-11-01T06:58:22.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61379 req_id = 80e087fd-489e-4a30-a2c5-e15301f352e1 response_code = 204 uri = /eip-gateways
21862024-11-01T06:58:22.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61379 req_id = 8da17f09-39f4-44fd-a316-4ac4e272a3f1 response_code = 204 uri = /vpc-routes
21872024-11-01T06:58:22.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63850
21882024-11-01T06:58:22.216ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21892024-11-01T06:58:22.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21902024-11-01T06:58:22.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63850 req_id = e6d91383-2209-4e39-a7fa-98f5bc858a0e response_code = 204 uri = /switch-ports
21912024-11-01T06:58:22.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63850 req_id = 60ca6b4d-4e04-4980-973b-f6d1e3112780 response_code = 200 uri = /network-bootstore-config
21922024-11-01T06:58:22.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55723
21932024-11-01T06:58:22.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55723 req_id = 32cf3069-f3b5-47ba-b667-570b3d840ba6 response_code = 200 uri = /vpc-routes
21942024-11-01T06:58:22.398ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
21952024-11-01T06:58:22.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55723 req_id = efe77202-30ca-4e1c-84fd-c849be8b7a52 response_code = 204 uri = /eip-gateways
21962024-11-01T06:58:22.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55723 req_id = 1d8579ed-c9b4-43df-9464-0a1a52c5cbf7 response_code = 204 uri = /vpc-routes
21972024-11-01T06:58:22.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60507
21982024-11-01T06:58:22.573ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21992024-11-01T06:58:22.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22002024-11-01T06:58:22.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100586 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60507 req_id = aef76088-705c-4247-b6d6-b8f4855352f6 response_code = 204 uri = /switch-ports
22012024-11-01T06:58:22.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34123
22022024-11-01T06:58:22.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60507 req_id = 8f028200-a72e-4987-b690-b2139e5a9f5c response_code = 200 uri = /network-bootstore-config
22032024-11-01T06:58:22.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34123 req_id = 8a8b993a-a8f0-4b1a-a3d7-61186b0e9aa6 response_code = 200 uri = /v2p
22042024-11-01T06:58:26.135ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39795
22052024-11-01T06:58:26.136ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39795 req_id = be306228-b9ca-4665-b96c-48a735ad23dc response_code = 200 uri = /baseboard
22062024-11-01T06:58:29.242ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22072024-11-01T06:58:29.244ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22082024-11-01T06:58:29.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22092024-11-01T06:58:29.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22102024-11-01T06:58:29.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22112024-11-01T06:58:35.230ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22122024-11-01T06:58:35.231ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22132024-11-01T06:58:35.232ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22142024-11-01T06:58:35.232ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22152024-11-01T06:58:37.218ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22162024-11-01T06:58:37.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22172024-11-01T06:58:37.723ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22182024-11-01T06:58:37.731ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22192024-11-01T06:58:38.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22202024-11-01T06:58:39.187ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22212024-11-01T06:58:39.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22222024-11-01T06:58:39.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22232024-11-01T06:58:39.247ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22242024-11-01T06:58:39.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22252024-11-01T06:58:39.255ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22262024-11-01T06:58:39.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22272024-11-01T06:58:39.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22282024-11-01T06:58:39.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22292024-11-01T06:58:45.233ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22302024-11-01T06:58:45.233ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22312024-11-01T06:58:45.234ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22322024-11-01T06:58:45.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22332024-11-01T06:58:47.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22342024-11-01T06:58:47.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22352024-11-01T06:58:47.725ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22362024-11-01T06:58:47.733ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22372024-11-01T06:58:48.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22382024-11-01T06:58:49.189ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22392024-11-01T06:58:49.247ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22402024-11-01T06:58:49.248ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22412024-11-01T06:58:49.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22422024-11-01T06:58:49.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22432024-11-01T06:58:49.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22442024-11-01T06:58:49.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22452024-11-01T06:58:49.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22462024-11-01T06:58:49.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22472024-11-01T06:58:51.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36474
22482024-11-01T06:58:51.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36474 req_id = 8c0b752f-0afc-472c-af5f-68f72ba4953a response_code = 200 uri = /v2p
22492024-11-01T06:58:51.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44190
22502024-11-01T06:58:51.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44190 req_id = 08e3fc5a-d140-4174-ae5b-83f3b0037be9 response_code = 200 uri = /vpc-routes
22512024-11-01T06:58:51.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
22522024-11-01T06:58:51.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44190 req_id = 1313385a-b84d-47b8-ba2a-3fe29df1273f response_code = 204 uri = /eip-gateways
22532024-11-01T06:58:51.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44190 req_id = 096e5eaf-1e69-464d-b416-79f46614d4a8 response_code = 204 uri = /vpc-routes
22542024-11-01T06:58:51.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47288
22552024-11-01T06:58:51.646ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22562024-11-01T06:58:51.686ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22572024-11-01T06:58:51.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107061 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47288 req_id = 02125832-483a-4a9c-af3e-76c1a8d62653 response_code = 204 uri = /switch-ports
22582024-11-01T06:58:51.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47288 req_id = 129ecc13-5d0d-414f-a339-9c40bd5321ce response_code = 200 uri = /network-bootstore-config
22592024-11-01T06:58:51.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58207
22602024-11-01T06:58:51.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58207 req_id = ff849637-185a-48e8-841e-395153cbff3c response_code = 200 uri = /vpc-routes
22612024-11-01T06:58:52.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
22622024-11-01T06:58:52.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58207 req_id = 26bfb243-537d-42f2-b06b-aaa3cefb54b5 response_code = 204 uri = /eip-gateways
22632024-11-01T06:58:52.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58207 req_id = 1ac6e945-16ad-4984-8285-0bda672eac4f response_code = 204 uri = /vpc-routes
22642024-11-01T06:58:52.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36002
22652024-11-01T06:58:52.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36002 req_id = 7e5ac2b7-bf35-40e4-a707-fd7ae4aea4a4 response_code = 200 uri = /v2p
22662024-11-01T06:58:52.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64611
22672024-11-01T06:58:52.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22682024-11-01T06:58:52.196ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22692024-11-01T06:58:52.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126807 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64611 req_id = 270f7134-a688-4e5d-90d3-eee75a3dc81e response_code = 204 uri = /switch-ports
22702024-11-01T06:58:52.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64611 req_id = 63004ae6-15a3-440a-baf5-ddc24986626e response_code = 200 uri = /network-bootstore-config
22712024-11-01T06:58:52.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47808
22722024-11-01T06:58:52.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47808 req_id = da6b893d-0ab0-426d-bee7-899ff7c694c1 response_code = 200 uri = /v2p
22732024-11-01T06:58:52.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40329
22742024-11-01T06:58:52.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40329 req_id = da48e68b-45e3-44aa-bc1b-d08dcb22c537 response_code = 200 uri = /vpc-routes
22752024-11-01T06:58:52.445ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
22762024-11-01T06:58:52.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40329 req_id = 30dc767a-f921-4e07-a907-bee0d6a02f6a response_code = 204 uri = /eip-gateways
22772024-11-01T06:58:52.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40329 req_id = 7aea2e4f-bde0-42af-b2e1-714e1437b74d response_code = 204 uri = /vpc-routes
22782024-11-01T06:58:52.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37079
22792024-11-01T06:58:52.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22802024-11-01T06:58:52.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22812024-11-01T06:58:52.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96656 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37079 req_id = 523f10f7-9785-4be6-84bf-deafce4b0047 response_code = 204 uri = /switch-ports
22822024-11-01T06:58:52.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37079 req_id = f26f813f-3d10-4af4-9a84-0ef92ed9fbd7 response_code = 200 uri = /network-bootstore-config
22832024-11-01T06:58:55.234ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22842024-11-01T06:58:55.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22852024-11-01T06:58:55.236ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22862024-11-01T06:58:55.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22872024-11-01T06:58:56.170ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51018
22882024-11-01T06:58:56.170ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51018 req_id = fdb32ece-4e05-42b5-90df-3c2f34f47713 response_code = 200 uri = /baseboard
22892024-11-01T06:58:57.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22902024-11-01T06:58:57.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22912024-11-01T06:58:57.727ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22922024-11-01T06:58:57.735ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22932024-11-01T06:58:58.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22942024-11-01T06:58:59.192ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22952024-11-01T06:58:59.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22962024-11-01T06:58:59.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22972024-11-01T06:58:59.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22982024-11-01T06:58:59.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
22992024-11-01T06:58:59.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23002024-11-01T06:58:59.263ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23012024-11-01T06:58:59.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23022024-11-01T06:58:59.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23032024-11-01T06:59:04.990ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23042024-11-01T06:59:04.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
23052024-11-01T06:59:05.022ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3188, tv_nsec: 779455093 } time_to_next_cleanup = 599.9999981s
23062024-11-01T06:59:05.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23072024-11-01T06:59:05.238ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23082024-11-01T06:59:05.239ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23092024-11-01T06:59:05.239ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23102024-11-01T06:59:07.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23112024-11-01T06:59:07.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23122024-11-01T06:59:07.730ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23132024-11-01T06:59:07.737ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23142024-11-01T06:59:08.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23152024-11-01T06:59:09.194ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23162024-11-01T06:59:09.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23172024-11-01T06:59:09.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23182024-11-01T06:59:09.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23192024-11-01T06:59:09.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23202024-11-01T06:59:09.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23212024-11-01T06:59:09.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23222024-11-01T06:59:09.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23232024-11-01T06:59:09.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23242024-11-01T06:59:15.240ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23252024-11-01T06:59:15.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23262024-11-01T06:59:15.242ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23272024-11-01T06:59:15.243ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23282024-11-01T06:59:17.226ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23292024-11-01T06:59:17.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23302024-11-01T06:59:17.733ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23312024-11-01T06:59:17.740ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23322024-11-01T06:59:18.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23332024-11-01T06:59:19.197ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23342024-11-01T06:59:19.255ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23352024-11-01T06:59:19.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23362024-11-01T06:59:19.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23372024-11-01T06:59:19.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23382024-11-01T06:59:19.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23392024-11-01T06:59:19.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23402024-11-01T06:59:19.270ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23412024-11-01T06:59:19.270ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23422024-11-01T06:59:19.405ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23432024-11-01T06:59:21.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65137
23442024-11-01T06:59:21.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65137 req_id = ac3d5f08-a5a6-49da-b912-83484f11e8ca response_code = 200 uri = /vpc-routes
23452024-11-01T06:59:21.614ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
23462024-11-01T06:59:21.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65137 req_id = 73a0b68b-1dd6-4483-b65e-02197e9b49b4 response_code = 204 uri = /eip-gateways
23472024-11-01T06:59:21.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65137 req_id = b9b2869b-4040-45d8-9ce5-5da8ec4ab461 response_code = 204 uri = /vpc-routes
23482024-11-01T06:59:21.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33948
23492024-11-01T06:59:21.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33948 req_id = 4574d3c7-bd25-4737-817f-b19895009a29 response_code = 200 uri = /v2p
23502024-11-01T06:59:21.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54885
23512024-11-01T06:59:21.798ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23522024-11-01T06:59:21.852ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23532024-11-01T06:59:21.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135334 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54885 req_id = c76dad1d-4b82-4a6c-b604-9d3b0dc9c213 response_code = 204 uri = /switch-ports
23542024-11-01T06:59:21.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54885 req_id = 68d59aca-279a-496a-9a4a-d0f29aaaff68 response_code = 200 uri = /network-bootstore-config
23552024-11-01T06:59:22.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36833
23562024-11-01T06:59:22.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36833 req_id = d522e45e-6524-43a7-ba09-a704747912ec response_code = 200 uri = /vpc-routes
23572024-11-01T06:59:22.282ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
23582024-11-01T06:59:22.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36833 req_id = 332724dd-c6f7-461c-a8c5-81bf2f0a9dda response_code = 204 uri = /eip-gateways
23592024-11-01T06:59:22.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36833 req_id = a3e9a782-2d76-47da-9df9-57c231725c11 response_code = 204 uri = /vpc-routes
23602024-11-01T06:59:22.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33337
23612024-11-01T06:59:22.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33337 req_id = 489a865f-53e0-475d-9086-76a90e867080 response_code = 200 uri = /vpc-routes
23622024-11-01T06:59:22.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62048
23632024-11-01T06:59:22.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62048 req_id = ecc915ed-4758-4096-a9d8-01ab3f445d8b response_code = 200 uri = /v2p
23642024-11-01T06:59:22.362ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
23652024-11-01T06:59:22.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33337 req_id = 4489dc24-1e4a-44b6-8fa3-1d55ed201652 response_code = 204 uri = /eip-gateways
23662024-11-01T06:59:22.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33337 req_id = 9c72fc27-5a55-486e-880c-a1ea372a10c6 response_code = 204 uri = /vpc-routes
23672024-11-01T06:59:22.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44332
23682024-11-01T06:59:22.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23692024-11-01T06:59:22.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23702024-11-01T06:59:22.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44332 req_id = 6aa3e55f-96dc-410b-9a1d-82314117daa2 response_code = 204 uri = /switch-ports
23712024-11-01T06:59:22.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44332 req_id = d8eae08f-fb7c-4866-a9a7-36c0e866b47c response_code = 200 uri = /network-bootstore-config
23722024-11-01T06:59:22.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40081
23732024-11-01T06:59:22.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23742024-11-01T06:59:22.610ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23752024-11-01T06:59:22.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108365 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40081 req_id = f590798f-85c3-4d93-bbfe-5e4b76023f30 response_code = 204 uri = /switch-ports
23762024-11-01T06:59:22.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59140
23772024-11-01T06:59:22.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40081 req_id = d0c345f7-5178-415c-adb2-ae6cf7ce1047 response_code = 200 uri = /network-bootstore-config
23782024-11-01T06:59:22.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59140 req_id = 0b2b061f-8a10-4e87-a96b-5b2c60e05c87 response_code = 200 uri = /v2p
23792024-11-01T06:59:25.243ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23802024-11-01T06:59:25.244ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23812024-11-01T06:59:25.244ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23822024-11-01T06:59:25.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23832024-11-01T06:59:26.202ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41526
23842024-11-01T06:59:26.203ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41526 req_id = 363dee15-a614-41b3-ab1c-b4f085cac690 response_code = 200 uri = /baseboard
23852024-11-01T06:59:27.230ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23862024-11-01T06:59:27.231ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23872024-11-01T06:59:27.736ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23882024-11-01T06:59:27.742ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23892024-11-01T06:59:28.427ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23902024-11-01T06:59:29.199ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23912024-11-01T06:59:29.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23922024-11-01T06:59:29.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23932024-11-01T06:59:29.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23942024-11-01T06:59:29.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23952024-11-01T06:59:29.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23962024-11-01T06:59:29.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23972024-11-01T06:59:29.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23982024-11-01T06:59:29.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
23992024-11-01T06:59:35.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24002024-11-01T06:59:35.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24012024-11-01T06:59:35.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24022024-11-01T06:59:35.247ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24032024-11-01T06:59:37.232ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24042024-11-01T06:59:37.233ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24052024-11-01T06:59:37.739ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24062024-11-01T06:59:37.744ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24072024-11-01T06:59:38.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24082024-11-01T06:59:39.201ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24092024-11-01T06:59:39.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24102024-11-01T06:59:39.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24112024-11-01T06:59:39.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24122024-11-01T06:59:39.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24132024-11-01T06:59:39.267ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24142024-11-01T06:59:39.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24152024-11-01T06:59:39.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24162024-11-01T06:59:39.275ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24172024-11-01T06:59:45.248ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24182024-11-01T06:59:45.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24192024-11-01T06:59:45.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24202024-11-01T06:59:45.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24212024-11-01T06:59:47.234ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24222024-11-01T06:59:47.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24232024-11-01T06:59:47.741ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24242024-11-01T06:59:47.745ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24252024-11-01T06:59:48.434ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24262024-11-01T06:59:49.204ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24272024-11-01T06:59:49.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24282024-11-01T06:59:49.263ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24292024-11-01T06:59:49.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24302024-11-01T06:59:49.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24312024-11-01T06:59:49.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24322024-11-01T06:59:49.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24332024-11-01T06:59:49.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24342024-11-01T06:59:49.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24352024-11-01T06:59:51.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37859
24362024-11-01T06:59:51.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37859 req_id = ad317859-cda5-49ba-993a-140cc6c4c9bd response_code = 200 uri = /vpc-routes
24372024-11-01T06:59:51.504ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
24382024-11-01T06:59:51.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37859 req_id = 7e8947ed-a2e1-4908-83bb-1486db802128 response_code = 204 uri = /eip-gateways
24392024-11-01T06:59:51.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37859 req_id = 64ff3cbf-b8be-4725-ab3c-bac5e9bed567 response_code = 204 uri = /vpc-routes
24402024-11-01T06:59:51.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56014
24412024-11-01T06:59:51.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56014 req_id = 68fe2b57-ac7c-46f6-9021-a800c4b4db77 response_code = 200 uri = /v2p
24422024-11-01T06:59:51.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57657
24432024-11-01T06:59:51.643ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24442024-11-01T06:59:51.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24452024-11-01T06:59:51.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57657 req_id = 3e4f2ac8-a812-4106-9bff-bb33a5b1edf8 response_code = 204 uri = /switch-ports
24462024-11-01T06:59:51.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57657 req_id = 87d08a0f-8673-4e13-a13a-e48889a6af92 response_code = 200 uri = /network-bootstore-config
24472024-11-01T06:59:52.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39528
24482024-11-01T06:59:52.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39528 req_id = 9bdbdabf-7390-4110-80f5-495390e55f69 response_code = 200 uri = /vpc-routes
24492024-11-01T06:59:52.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
24502024-11-01T06:59:52.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39528 req_id = 521ef3ab-7eb7-4e0b-b5ef-5f4a26b4f462 response_code = 204 uri = /eip-gateways
24512024-11-01T06:59:52.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41923
24522024-11-01T06:59:52.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41923 req_id = ec4db9cf-055d-470c-874d-7885485b8c63 response_code = 200 uri = /v2p
24532024-11-01T06:59:52.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39528 req_id = 3911d119-d873-415a-9783-7e31678f099a response_code = 204 uri = /vpc-routes
24542024-11-01T06:59:52.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53494
24552024-11-01T06:59:52.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24562024-11-01T06:59:52.306ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24572024-11-01T06:59:52.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53494 req_id = be6efb83-de03-413e-acb7-323aedf19205 response_code = 204 uri = /switch-ports
24582024-11-01T06:59:52.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36319
24592024-11-01T06:59:52.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36319 req_id = de9a963e-9c3a-4637-bbc0-f9fa0b4f2aa7 response_code = 200 uri = /vpc-routes
24602024-11-01T06:59:52.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53494 req_id = 8c021b43-d907-466b-99c9-347f92d11604 response_code = 200 uri = /network-bootstore-config
24612024-11-01T06:59:52.405ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
24622024-11-01T06:59:52.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36319 req_id = b7cca563-0901-4f80-80fc-27f10d25d490 response_code = 204 uri = /eip-gateways
24632024-11-01T06:59:52.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39043
24642024-11-01T06:59:52.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39043 req_id = 26db15be-9280-49e7-bacc-45c321b451d5 response_code = 200 uri = /v2p
24652024-11-01T06:59:52.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36319 req_id = a4346bc1-aee1-43b2-94c2-9040f7cf8c2a response_code = 204 uri = /vpc-routes
24662024-11-01T06:59:52.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48979
24672024-11-01T06:59:52.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24682024-11-01T06:59:52.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24692024-11-01T06:59:52.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48979 req_id = ad4f4a4d-6e2a-4697-bee6-05b52abc1b65 response_code = 204 uri = /switch-ports
24702024-11-01T06:59:52.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48979 req_id = ddab3b0e-3db6-441a-b857-cb331a7e9427 response_code = 200 uri = /network-bootstore-config
24712024-11-01T06:59:55.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24722024-11-01T06:59:55.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24732024-11-01T06:59:55.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24742024-11-01T06:59:55.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24752024-11-01T06:59:56.235ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39694
24762024-11-01T06:59:56.235ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39694 req_id = 3875f703-f480-4ac5-b541-b670c8f0cabd response_code = 200 uri = /baseboard
24772024-11-01T06:59:57.236ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24782024-11-01T06:59:57.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24792024-11-01T06:59:57.744ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24802024-11-01T06:59:57.748ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24812024-11-01T06:59:58.438ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24822024-11-01T06:59:59.206ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24832024-11-01T06:59:59.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24842024-11-01T06:59:59.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24852024-11-01T06:59:59.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24862024-11-01T06:59:59.270ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24872024-11-01T06:59:59.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24882024-11-01T06:59:59.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24892024-11-01T06:59:59.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24902024-11-01T06:59:59.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24912024-11-01T07:00:05.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24922024-11-01T07:00:05.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24932024-11-01T07:00:05.255ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24942024-11-01T07:00:05.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24952024-11-01T07:00:07.239ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24962024-11-01T07:00:07.240ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24972024-11-01T07:00:07.745ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24982024-11-01T07:00:07.749ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
24992024-11-01T07:00:08.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25002024-11-01T07:00:09.208ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25012024-11-01T07:00:09.267ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25022024-11-01T07:00:09.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25032024-11-01T07:00:09.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25042024-11-01T07:00:09.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25052024-11-01T07:00:09.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25062024-11-01T07:00:09.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25072024-11-01T07:00:09.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25082024-11-01T07:00:09.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25092024-11-01T07:00:15.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25102024-11-01T07:00:15.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25112024-11-01T07:00:15.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25122024-11-01T07:00:15.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25132024-11-01T07:00:17.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25142024-11-01T07:00:17.242ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25152024-11-01T07:00:17.748ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25162024-11-01T07:00:17.751ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25172024-11-01T07:00:18.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25182024-11-01T07:00:19.211ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25192024-11-01T07:00:19.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25202024-11-01T07:00:19.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25212024-11-01T07:00:19.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25222024-11-01T07:00:19.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25232024-11-01T07:00:19.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25242024-11-01T07:00:19.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25252024-11-01T07:00:19.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25262024-11-01T07:00:19.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25272024-11-01T07:00:21.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56842
25282024-11-01T07:00:21.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56842 req_id = fc4c3ecf-a4ad-453f-9266-52c7afb249e8 response_code = 200 uri = /vpc-routes
25292024-11-01T07:00:21.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
25302024-11-01T07:00:21.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56842 req_id = 59ad8006-c657-4d62-a8e6-4b5a4eb058c1 response_code = 204 uri = /eip-gateways
25312024-11-01T07:00:21.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56842 req_id = a9b1dec6-91e7-4ab3-b8c8-d50db54b409e response_code = 204 uri = /vpc-routes
25322024-11-01T07:00:21.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53202
25332024-11-01T07:00:21.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53202 req_id = 01baed94-3571-4702-963b-8ed4d7a0322d response_code = 200 uri = /v2p
25342024-11-01T07:00:21.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61702
25352024-11-01T07:00:21.749ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25362024-11-01T07:00:21.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25372024-11-01T07:00:21.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61702 req_id = 2d608107-66d8-4029-8fbc-572eb4e6be7c response_code = 204 uri = /switch-ports
25382024-11-01T07:00:21.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61702 req_id = b189b9ef-7ddd-41ea-a1f5-48c7946fafc0 response_code = 200 uri = /network-bootstore-config
25392024-11-01T07:00:22.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50653
25402024-11-01T07:00:22.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50653 req_id = 9a2fec03-98db-476d-b44a-77e66bc7b147 response_code = 200 uri = /v2p
25412024-11-01T07:00:22.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59083
25422024-11-01T07:00:22.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59083 req_id = 2259cca6-e2aa-45c3-af65-d9974ca15022 response_code = 200 uri = /vpc-routes
25432024-11-01T07:00:22.206ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
25442024-11-01T07:00:22.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59083 req_id = 1f3c3212-57d6-41e4-8689-b70c812a246b response_code = 204 uri = /eip-gateways
25452024-11-01T07:00:22.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59083 req_id = c7e7488f-261d-4e1c-8f5c-42a0e46265d4 response_code = 204 uri = /vpc-routes
25462024-11-01T07:00:22.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38086
25472024-11-01T07:00:22.253ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25482024-11-01T07:00:22.296ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25492024-11-01T07:00:22.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38086 req_id = 6247248b-4cc2-4537-836c-7bf0d3b17871 response_code = 204 uri = /switch-ports
25502024-11-01T07:00:22.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38086 req_id = ab6263fd-62a7-46cc-8fc1-e8627396b98c response_code = 200 uri = /network-bootstore-config
25512024-11-01T07:00:22.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60704
25522024-11-01T07:00:22.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60704 req_id = 39929b8e-840b-4ade-86d8-99db722b38db response_code = 200 uri = /vpc-routes
25532024-11-01T07:00:22.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50915
25542024-11-01T07:00:22.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50915 req_id = 19c7c4f5-812e-4140-9cb4-196596b93cc9 response_code = 200 uri = /v2p
25552024-11-01T07:00:22.489ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
25562024-11-01T07:00:22.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60704 req_id = 68cfe4db-6b56-4067-84c9-cc317fd7044f response_code = 204 uri = /eip-gateways
25572024-11-01T07:00:22.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60704 req_id = 34baf418-d72e-4736-bb75-f1e7c602f19b response_code = 204 uri = /vpc-routes
25582024-11-01T07:00:22.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48608
25592024-11-01T07:00:22.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25602024-11-01T07:00:22.724ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25612024-11-01T07:00:22.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48608 req_id = b658807b-d059-4bdf-ad85-25ed990d9b30 response_code = 204 uri = /switch-ports
25622024-11-01T07:00:22.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48608 req_id = f6232c5b-f896-4c60-ad9d-6f9ce5b8e121 response_code = 200 uri = /network-bootstore-config
25632024-11-01T07:00:25.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25642024-11-01T07:00:25.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25652024-11-01T07:00:25.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25662024-11-01T07:00:25.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25672024-11-01T07:00:26.267ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65416
25682024-11-01T07:00:26.268ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65416 req_id = 3285a68e-a72c-40d0-96d8-aa1ca786264b response_code = 200 uri = /baseboard
25692024-11-01T07:00:27.243ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25702024-11-01T07:00:27.244ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25712024-11-01T07:00:27.750ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25722024-11-01T07:00:27.753ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25732024-11-01T07:00:28.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25742024-11-01T07:00:29.213ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25752024-11-01T07:00:29.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25762024-11-01T07:00:29.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25772024-11-01T07:00:29.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25782024-11-01T07:00:29.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25792024-11-01T07:00:29.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25802024-11-01T07:00:29.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25812024-11-01T07:00:29.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25822024-11-01T07:00:29.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25832024-11-01T07:00:35.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25842024-11-01T07:00:35.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25852024-11-01T07:00:35.263ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25862024-11-01T07:00:35.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25872024-11-01T07:00:37.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25882024-11-01T07:00:37.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25892024-11-01T07:00:37.753ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25902024-11-01T07:00:37.756ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25912024-11-01T07:00:38.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25922024-11-01T07:00:39.216ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25932024-11-01T07:00:39.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25942024-11-01T07:00:39.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25952024-11-01T07:00:39.275ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25962024-11-01T07:00:39.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25972024-11-01T07:00:39.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25982024-11-01T07:00:39.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
25992024-11-01T07:00:39.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26002024-11-01T07:00:39.288ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26012024-11-01T07:00:45.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26022024-11-01T07:00:45.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26032024-11-01T07:00:45.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26042024-11-01T07:00:45.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26052024-11-01T07:00:47.248ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26062024-11-01T07:00:47.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26072024-11-01T07:00:47.755ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26082024-11-01T07:00:47.757ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26092024-11-01T07:00:48.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26102024-11-01T07:00:49.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26112024-11-01T07:00:49.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26122024-11-01T07:00:49.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26132024-11-01T07:00:49.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26142024-11-01T07:00:49.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26152024-11-01T07:00:49.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26162024-11-01T07:00:49.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26172024-11-01T07:00:49.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26182024-11-01T07:00:49.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26192024-11-01T07:00:51.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51849
26202024-11-01T07:00:51.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51849 req_id = b7192beb-fa3a-4aab-b778-508dcc468826 response_code = 200 uri = /vpc-routes
26212024-11-01T07:00:51.507ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
26222024-11-01T07:00:51.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51849 req_id = f933adcb-e64a-45fc-8a6b-84cabf93d5c9 response_code = 204 uri = /eip-gateways
26232024-11-01T07:00:51.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51849 req_id = 3e1a4574-040d-4897-85a0-0f86fa89606c response_code = 204 uri = /vpc-routes
26242024-11-01T07:00:51.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41371
26252024-11-01T07:00:51.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41371 req_id = 8a198e81-bffc-4e0f-84ef-94aef2982506 response_code = 200 uri = /v2p
26262024-11-01T07:00:51.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45596
26272024-11-01T07:00:51.639ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26282024-11-01T07:00:51.679ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26292024-11-01T07:00:51.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45596 req_id = 0fa4a741-9aa5-4f90-ad1b-60d00d263347 response_code = 204 uri = /switch-ports
26302024-11-01T07:00:51.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45596 req_id = 6c977c50-afc4-4f46-99fe-a53d5889fb9b response_code = 200 uri = /network-bootstore-config
26312024-11-01T07:00:51.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34340
26322024-11-01T07:00:51.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34340 req_id = 6d65293c-1182-411d-857e-12ea0a802db9 response_code = 200 uri = /vpc-routes
26332024-11-01T07:00:51.923ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
26342024-11-01T07:00:51.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34340 req_id = a6974370-8fc0-4eeb-9a49-146c8e0586ac response_code = 204 uri = /eip-gateways
26352024-11-01T07:00:51.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34340 req_id = ca546efd-c5fb-4236-870b-f3ad3b8320d2 response_code = 204 uri = /vpc-routes
26362024-11-01T07:00:52.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50491
26372024-11-01T07:00:52.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50491 req_id = 6e66237f-aa28-42a5-b930-a5595759ba88 response_code = 200 uri = /v2p
26382024-11-01T07:00:52.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62971
26392024-11-01T07:00:52.067ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26402024-11-01T07:00:52.112ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26412024-11-01T07:00:52.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122771 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62971 req_id = 010da102-231b-4451-9e35-2fb3d3d62b90 response_code = 204 uri = /switch-ports
26422024-11-01T07:00:52.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62971 req_id = d53bb18e-b03e-4eb4-a5b2-be6f0a921f94 response_code = 200 uri = /network-bootstore-config
26432024-11-01T07:00:52.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47099
26442024-11-01T07:00:52.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47099 req_id = ef113964-17be-443c-b77b-51a7e5650571 response_code = 200 uri = /vpc-routes
26452024-11-01T07:00:52.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44848
26462024-11-01T07:00:52.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44848 req_id = c8ea8c70-f864-449d-9b6b-9312c50852f4 response_code = 200 uri = /v2p
26472024-11-01T07:00:52.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
26482024-11-01T07:00:52.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47099 req_id = f0616b76-f56c-4cfe-8553-8b5124f5c761 response_code = 204 uri = /eip-gateways
26492024-11-01T07:00:52.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47099 req_id = d10533bb-5311-4870-9405-14817d45806c response_code = 204 uri = /vpc-routes
26502024-11-01T07:00:52.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61860
26512024-11-01T07:00:52.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26522024-11-01T07:00:52.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26532024-11-01T07:00:52.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61860 req_id = 067de62c-79a3-491a-b412-c462f237317a response_code = 204 uri = /switch-ports
26542024-11-01T07:00:52.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61860 req_id = 651ef686-5938-4fdd-8a41-691cef2194ac response_code = 200 uri = /network-bootstore-config
26552024-11-01T07:00:55.267ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26562024-11-01T07:00:55.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26572024-11-01T07:00:55.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26582024-11-01T07:00:55.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26592024-11-01T07:00:56.301ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54359
26602024-11-01T07:00:56.301ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54359 req_id = 3273a3c4-b4c9-44da-98a3-5521c3b163c9 response_code = 200 uri = /baseboard
26612024-11-01T07:00:57.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26622024-11-01T07:00:57.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26632024-11-01T07:00:57.757ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26642024-11-01T07:00:57.759ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26652024-11-01T07:00:58.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26662024-11-01T07:00:59.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26672024-11-01T07:00:59.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26682024-11-01T07:00:59.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26692024-11-01T07:00:59.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26702024-11-01T07:00:59.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26712024-11-01T07:00:59.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26722024-11-01T07:00:59.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26732024-11-01T07:00:59.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26742024-11-01T07:00:59.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26752024-11-01T07:01:05.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26762024-11-01T07:01:05.270ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26772024-11-01T07:01:05.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26782024-11-01T07:01:05.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26792024-11-01T07:01:07.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26802024-11-01T07:01:07.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26812024-11-01T07:01:07.760ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26822024-11-01T07:01:07.762ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26832024-11-01T07:01:08.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26842024-11-01T07:01:09.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26852024-11-01T07:01:09.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26862024-11-01T07:01:09.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26872024-11-01T07:01:09.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26882024-11-01T07:01:09.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26892024-11-01T07:01:09.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26902024-11-01T07:01:09.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26912024-11-01T07:01:09.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26922024-11-01T07:01:09.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26932024-11-01T07:01:15.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26942024-11-01T07:01:15.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26952024-11-01T07:01:15.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26962024-11-01T07:01:15.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26972024-11-01T07:01:17.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26982024-11-01T07:01:17.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
26992024-11-01T07:01:17.762ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27002024-11-01T07:01:17.764ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27012024-11-01T07:01:18.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27022024-11-01T07:01:19.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27032024-11-01T07:01:19.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27042024-11-01T07:01:19.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27052024-11-01T07:01:19.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27062024-11-01T07:01:19.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27072024-11-01T07:01:19.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27082024-11-01T07:01:19.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27092024-11-01T07:01:19.296ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27102024-11-01T07:01:19.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27112024-11-01T07:01:21.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35340
27122024-11-01T07:01:21.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35340 req_id = b25ab55a-a535-4e14-a3ae-266fbef37531 response_code = 200 uri = /vpc-routes
27132024-11-01T07:01:21.665ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
27142024-11-01T07:01:21.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35340 req_id = 7ff45c5a-716c-42b4-a5d4-c2cd862ebe64 response_code = 204 uri = /eip-gateways
27152024-11-01T07:01:21.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35340 req_id = dde05b27-d43f-439d-8f93-54e8ba9772b4 response_code = 204 uri = /vpc-routes
27162024-11-01T07:01:21.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46946
27172024-11-01T07:01:21.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46946 req_id = 0d3c4f71-5884-4634-93ed-07f0b12a3aa9 response_code = 200 uri = /v2p
27182024-11-01T07:01:21.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50040
27192024-11-01T07:01:21.842ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27202024-11-01T07:01:21.897ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27212024-11-01T07:01:21.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50040 req_id = dfc01f3c-93c6-4900-9411-99bac2beb0c7 response_code = 204 uri = /switch-ports
27222024-11-01T07:01:21.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50941
27232024-11-01T07:01:21.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39473
27242024-11-01T07:01:21.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50040 req_id = 522109e3-504f-4189-b588-566bbe6c6ff1 response_code = 200 uri = /network-bootstore-config
27252024-11-01T07:01:21.966ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27262024-11-01T07:01:21.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27272024-11-01T07:01:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27282024-11-01T07:01:21.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27292024-11-01T07:01:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27302024-11-01T07:01:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27312024-11-01T07:01:21.966ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
27322024-11-01T07:01:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27332024-11-01T07:01:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27342024-11-01T07:01:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27352024-11-01T07:01:21.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39473 req_id = bd953137-a9dd-439b-9726-c4ca892c5b9a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27362024-11-01T07:01:21.967ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
27372024-11-01T07:01:22.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64282
27382024-11-01T07:01:22.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64282 req_id = 59fbbebf-4e5f-48af-80f3-ef91b0147adb response_code = 200 uri = /vpc-routes
27392024-11-01T07:01:22.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
27402024-11-01T07:01:22.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64282 req_id = ce7be224-bbe2-4fbb-87ca-1439508afc2c response_code = 204 uri = /eip-gateways
27412024-11-01T07:01:22.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64282 req_id = c987ef31-26e3-4235-8367-1d6d9a0edcaa response_code = 204 uri = /vpc-routes
27422024-11-01T07:01:22.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 278513 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50941 req_id = 3d14614f-e3c2-4261-b309-7e20eff051cc response_code = 200 uri = /inventory
27432024-11-01T07:01:22.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62534
27442024-11-01T07:01:22.292ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27452024-11-01T07:01:22.292ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27462024-11-01T07:01:22.292ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
27472024-11-01T07:01:22.292ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
27482024-11-01T07:01:22.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38334
27492024-11-01T07:01:22.317ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27502024-11-01T07:01:22.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27512024-11-01T07:01:22.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38334 req_id = bc048821-3f97-4b5f-9ee0-a2f5dcf60f05 response_code = 204 uri = /switch-ports
27522024-11-01T07:01:22.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36963
27532024-11-01T07:01:22.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36963 req_id = 00667c63-5e99-4392-87f8-f78ed70cb4c8 response_code = 200 uri = /v2p
27542024-11-01T07:01:22.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38334 req_id = c01793b3-db2d-4f18-9342-3727a8e5be67 response_code = 200 uri = /network-bootstore-config
27552024-11-01T07:01:22.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47794
27562024-11-01T07:01:22.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47794 req_id = 5744f2bf-90ed-4e44-9d9f-c34461e1a1ad response_code = 200 uri = /vpc-routes
27572024-11-01T07:01:22.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39171
27582024-11-01T07:01:22.508ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27592024-11-01T07:01:22.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27602024-11-01T07:01:22.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27612024-11-01T07:01:22.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27622024-11-01T07:01:22.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27632024-11-01T07:01:22.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27642024-11-01T07:01:22.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27652024-11-01T07:01:22.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39171 req_id = 279cb3cb-e39d-4a96-b16f-1f55374f696a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27662024-11-01T07:01:22.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
27672024-11-01T07:01:22.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47794 req_id = ac008625-4c9b-486b-9750-fb26c0d02413 response_code = 204 uri = /eip-gateways
27682024-11-01T07:01:22.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62534 req_id = c0307d2b-b40a-4611-89fc-845ecab6ddc1 response_code = 200 uri = /inventory
27692024-11-01T07:01:22.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34496
27702024-11-01T07:01:22.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27712024-11-01T07:01:22.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27722024-11-01T07:01:22.606ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/config/omicron-zones.json file = common/src/ledger.rs:177
27732024-11-01T07:01:22.606ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/config/omicron-zones.json file = common/src/ledger.rs:177
27742024-11-01T07:01:22.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47794 req_id = 90b1d140-0fed-4ecf-94e3-6d44412e6ca7 response_code = 204 uri = /vpc-routes
27752024-11-01T07:01:22.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35599
27762024-11-01T07:01:22.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35599 req_id = 773f23b8-1f1a-4643-b352-0b9a31b9b162 response_code = 200 uri = /v2p
27772024-11-01T07:01:22.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37680
27782024-11-01T07:01:22.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27792024-11-01T07:01:22.726ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27802024-11-01T07:01:22.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37680 req_id = ed6f444d-b701-4901-8f28-56cfd79ee096 response_code = 204 uri = /switch-ports
27812024-11-01T07:01:22.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37729
27822024-11-01T07:01:22.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37680 req_id = dd727269-912a-4afd-8520-e4bd6e71b8c6 response_code = 200 uri = /network-bootstore-config
27832024-11-01T07:01:22.805ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 28424e26-ad84-449d-892b-918cdcb842df, kind: Service { id: afcf56b3-6c52-4787-9733-ac81e42c29e7 }, name: Name("external-dns-afcf56b3-6c52-4787-9733-ac81e42c29e7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d74c8225-a69c-4645-b8de-5c93506882bb, kind: Service { id: cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf }, name: Name("external-dns-cf58e77b-f89b-4ce3-aa2f-e9b42e79efaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 86])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b6c6575-e2e9-4acf-990e-6305c5db8836, kind: Service { id: 3e06a3b3-fdb2-4151-bcdc-6ac53a43e162 }, name: Name("nexus-3e06a3b3-fdb2-4151-bcdc-6ac53a43e162"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b75874-499a-4159-97d9-7eb7ed34c0df, kind: Service { id: 8d1426fc-0515-4a6d-979c-e17b886264e0 }, name: Name("nexus-8d1426fc-0515-4a6d-979c-e17b886264e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 42])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d7d150b4-8e86-40a4-88d3-61af1a44a6c9, kind: Service { id: 5aa7528a-ef22-4dfb-afba-980d8c246f4a }, name: Name("nexus-5aa7528a-ef22-4dfb-afba-980d8c246f4a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27842024-11-01T07:01:22.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27852024-11-01T07:01:22.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27862024-11-01T07:01:22.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27872024-11-01T07:01:22.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27882024-11-01T07:01:22.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27892024-11-01T07:01:22.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27902024-11-01T07:01:22.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37729 req_id = 106fe365-4372-4eab-a142-1c3362aa417e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27912024-11-01T07:01:22.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 268959 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34496 req_id = 92048b38-de2d-44ab-869c-be667dfa34ef response_code = 200 uri = /inventory
27922024-11-01T07:01:25.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27932024-11-01T07:01:25.275ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27942024-11-01T07:01:25.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27952024-11-01T07:01:25.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27962024-11-01T07:01:26.333ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62025
27972024-11-01T07:01:26.334ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62025 req_id = c75c52c9-a4b8-4521-bbc1-bd83758a056d response_code = 200 uri = /baseboard
27982024-11-01T07:01:27.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
27992024-11-01T07:01:27.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28002024-11-01T07:01:27.764ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28012024-11-01T07:01:27.766ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28022024-11-01T07:01:28.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28032024-11-01T07:01:29.230ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28042024-11-01T07:01:29.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28052024-11-01T07:01:29.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28062024-11-01T07:01:29.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28072024-11-01T07:01:29.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28082024-11-01T07:01:29.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28092024-11-01T07:01:29.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28102024-11-01T07:01:29.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28112024-11-01T07:01:29.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28122024-11-01T07:01:35.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28132024-11-01T07:01:35.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28142024-11-01T07:01:35.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28152024-11-01T07:01:35.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28162024-11-01T07:01:37.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28172024-11-01T07:01:37.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28182024-11-01T07:01:37.767ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28192024-11-01T07:01:37.769ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28202024-11-01T07:01:38.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28212024-11-01T07:01:39.233ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28222024-11-01T07:01:39.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28232024-11-01T07:01:39.288ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28242024-11-01T07:01:39.288ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28252024-11-01T07:01:39.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28262024-11-01T07:01:39.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28272024-11-01T07:01:39.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28282024-11-01T07:01:39.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28292024-11-01T07:01:39.302ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28302024-11-01T07:01:45.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28312024-11-01T07:01:45.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28322024-11-01T07:01:45.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28332024-11-01T07:01:45.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28342024-11-01T07:01:47.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28352024-11-01T07:01:47.263ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28362024-11-01T07:01:47.768ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28372024-11-01T07:01:47.770ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28382024-11-01T07:01:48.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28392024-11-01T07:01:49.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28402024-11-01T07:01:49.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28412024-11-01T07:01:49.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28422024-11-01T07:01:49.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28432024-11-01T07:01:49.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28442024-11-01T07:01:49.296ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28452024-11-01T07:01:49.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28462024-11-01T07:01:49.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28472024-11-01T07:01:49.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28482024-11-01T07:01:51.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46240
28492024-11-01T07:01:51.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46240 req_id = 7952179c-c6b2-4ceb-9537-a1cc84f152ca response_code = 200 uri = /vpc-routes
28502024-11-01T07:01:51.513ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
28512024-11-01T07:01:51.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46240 req_id = 89c6cb84-c4ac-4fbf-9858-c4d2c1ffdfc7 response_code = 204 uri = /eip-gateways
28522024-11-01T07:01:51.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56528
28532024-11-01T07:01:51.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56528 req_id = d0bf992e-36f7-48d6-8336-028e708314c0 response_code = 200 uri = /v2p
28542024-11-01T07:01:51.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46240 req_id = 71e070aa-b5f5-4f3f-8d83-7ed33dcf2f3f response_code = 204 uri = /vpc-routes
28552024-11-01T07:01:51.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55493
28562024-11-01T07:01:51.648ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28572024-11-01T07:01:51.689ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28582024-11-01T07:01:51.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99947 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55493 req_id = 563c00e0-dccd-4b0b-b1d5-38f2bcb97919 response_code = 204 uri = /switch-ports
28592024-11-01T07:01:51.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55493 req_id = 125ab449-0dc1-4424-9dbd-78c19dc17241 response_code = 200 uri = /network-bootstore-config
28602024-11-01T07:01:51.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41062
28612024-11-01T07:01:51.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41062 req_id = 1c688504-7eb0-4905-9c27-5bcb01a747d9 response_code = 200 uri = /vpc-routes
28622024-11-01T07:01:52.011ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
28632024-11-01T07:01:52.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41062 req_id = 8bbe7bc7-f759-4ec6-a538-81f7e7cc20df response_code = 204 uri = /eip-gateways
28642024-11-01T07:01:52.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41062 req_id = 1959fe47-f973-4aaf-bc2d-ca9bade502e4 response_code = 204 uri = /vpc-routes
28652024-11-01T07:01:52.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53470
28662024-11-01T07:01:52.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53470 req_id = cad85a0d-47f1-46c2-9c80-d4895e4a60cc response_code = 200 uri = /v2p
28672024-11-01T07:01:52.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36681
28682024-11-01T07:01:52.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28692024-11-01T07:01:52.127ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28702024-11-01T07:01:52.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36681 req_id = 60878812-e720-449e-b13b-fc8d6883d155 response_code = 204 uri = /switch-ports
28712024-11-01T07:01:52.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36681 req_id = 4d2abfa1-634c-4b46-9423-d1fd1a00b763 response_code = 200 uri = /network-bootstore-config
28722024-11-01T07:01:52.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42434
28732024-11-01T07:01:52.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42434 req_id = 22587109-b67e-483b-856e-22201a211683 response_code = 200 uri = /v2p
28742024-11-01T07:01:52.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41393
28752024-11-01T07:01:52.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41393 req_id = 987aa87c-6a7a-498b-a818-a4ea7a26a4c0 response_code = 200 uri = /vpc-routes
28762024-11-01T07:01:52.346ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
28772024-11-01T07:01:52.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41393 req_id = f4318238-05c4-4bb2-ae4c-6f377c3dcd45 response_code = 204 uri = /eip-gateways
28782024-11-01T07:01:52.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41393 req_id = 001234df-612e-4b1d-ab78-2793cc408189 response_code = 204 uri = /vpc-routes
28792024-11-01T07:01:52.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62004
28802024-11-01T07:01:52.390ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28812024-11-01T07:01:52.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28822024-11-01T07:01:52.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62004 req_id = ca8b90ed-29a9-4a57-8af1-abe638915f2d response_code = 204 uri = /switch-ports
28832024-11-01T07:01:52.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62004 req_id = 79ba6620-7ce0-4711-ad7d-6012a7118e52 response_code = 200 uri = /network-bootstore-config
28842024-11-01T07:01:55.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28852024-11-01T07:01:55.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28862024-11-01T07:01:55.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28872024-11-01T07:01:55.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28882024-11-01T07:01:56.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50012
28892024-11-01T07:01:56.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50012 req_id = b7e210a3-e9c7-4fb0-b849-7adba46184d1 response_code = 200 uri = /baseboard
28902024-11-01T07:01:57.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28912024-11-01T07:01:57.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28922024-11-01T07:01:57.772ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28932024-11-01T07:01:57.773ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28942024-11-01T07:01:58.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28952024-11-01T07:01:59.238ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28962024-11-01T07:01:59.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28972024-11-01T07:01:59.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28982024-11-01T07:01:59.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
28992024-11-01T07:01:59.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29002024-11-01T07:01:59.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29012024-11-01T07:01:59.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29022024-11-01T07:01:59.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29032024-11-01T07:01:59.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29042024-11-01T07:02:05.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29052024-11-01T07:02:05.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29062024-11-01T07:02:05.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29072024-11-01T07:02:05.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29082024-11-01T07:02:07.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29092024-11-01T07:02:07.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29102024-11-01T07:02:07.774ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29112024-11-01T07:02:07.775ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29122024-11-01T07:02:08.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29132024-11-01T07:02:09.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29142024-11-01T07:02:09.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29152024-11-01T07:02:09.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29162024-11-01T07:02:09.296ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29172024-11-01T07:02:09.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29182024-11-01T07:02:09.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29192024-11-01T07:02:09.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29202024-11-01T07:02:09.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29212024-11-01T07:02:09.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29222024-11-01T07:02:15.288ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29232024-11-01T07:02:15.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29242024-11-01T07:02:15.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29252024-11-01T07:02:15.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29262024-11-01T07:02:17.270ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29272024-11-01T07:02:17.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29282024-11-01T07:02:17.777ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29292024-11-01T07:02:17.777ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29302024-11-01T07:02:18.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29312024-11-01T07:02:19.243ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29322024-11-01T07:02:19.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29332024-11-01T07:02:19.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29342024-11-01T07:02:19.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29352024-11-01T07:02:19.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29362024-11-01T07:02:19.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29372024-11-01T07:02:19.302ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29382024-11-01T07:02:19.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29392024-11-01T07:02:19.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29402024-11-01T07:02:21.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61472
29412024-11-01T07:02:21.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61472 req_id = 1bf61941-8875-4a2c-bf75-314c0df36d1d response_code = 200 uri = /vpc-routes
29422024-11-01T07:02:21.701ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
29432024-11-01T07:02:21.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61472 req_id = 06ca4db3-6da9-4389-97eb-28366b1be24e response_code = 204 uri = /eip-gateways
29442024-11-01T07:02:21.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61472 req_id = 9e3e92ba-275b-4d99-bf64-43135ed7b838 response_code = 204 uri = /vpc-routes
29452024-11-01T07:02:21.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49285
29462024-11-01T07:02:21.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49285 req_id = e889f652-b757-4b2e-b3f9-66f06c9b6de5 response_code = 200 uri = /v2p
29472024-11-01T07:02:21.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51022
29482024-11-01T07:02:21.814ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29492024-11-01T07:02:21.864ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29502024-11-01T07:02:21.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51022 req_id = 9869db6b-4bdb-4a95-9dba-39e1c5f2fee0 response_code = 204 uri = /switch-ports
29512024-11-01T07:02:21.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51022 req_id = 6668d41c-a5fd-4322-8929-cf4062742042 response_code = 200 uri = /network-bootstore-config
29522024-11-01T07:02:21.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61047
29532024-11-01T07:02:21.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61047 req_id = 498b8c78-3875-44c2-88a1-0ab6dbcecefe response_code = 200 uri = /vpc-routes
29542024-11-01T07:02:22.032ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
29552024-11-01T07:02:22.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61047 req_id = 3dd69b84-54cb-4545-83e6-c4ee3ba96178 response_code = 204 uri = /eip-gateways
29562024-11-01T07:02:22.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61047 req_id = b90f2e03-a320-4e92-9cc9-95a6a48426d6 response_code = 204 uri = /vpc-routes
29572024-11-01T07:02:22.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32979
29582024-11-01T07:02:22.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32979 req_id = fb2c11e1-1f7b-4c22-b8d6-f715d601b225 response_code = 200 uri = /v2p
29592024-11-01T07:02:22.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34564
29602024-11-01T07:02:22.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29612024-11-01T07:02:22.397ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29622024-11-01T07:02:22.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34564 req_id = 7da63d59-01b2-468e-99c0-835ecce63879 response_code = 204 uri = /switch-ports
29632024-11-01T07:02:22.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56216
29642024-11-01T07:02:22.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56216 req_id = f22de7c3-10a9-4877-8474-778bf34bd02f response_code = 200 uri = /vpc-routes
29652024-11-01T07:02:22.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34564 req_id = bb42f92c-ef12-4c2e-8f59-7b0d280bb53f response_code = 200 uri = /network-bootstore-config
29662024-11-01T07:02:22.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38659
29672024-11-01T07:02:22.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38659 req_id = df66d788-ef8f-484a-8f57-beaa54b344e3 response_code = 200 uri = /v2p
29682024-11-01T07:02:22.501ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
29692024-11-01T07:02:22.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56216 req_id = eee2f9bf-a6fc-4e6f-8b76-30abbebe6332 response_code = 204 uri = /eip-gateways
29702024-11-01T07:02:22.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56216 req_id = 9350c0be-d63d-47b6-9f53-49d84d59bdbc response_code = 204 uri = /vpc-routes
29712024-11-01T07:02:22.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55610
29722024-11-01T07:02:22.770ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29732024-11-01T07:02:22.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29742024-11-01T07:02:22.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55610 req_id = 2f732ba8-ffeb-4038-b74e-02ca2ca2678f response_code = 204 uri = /switch-ports
29752024-11-01T07:02:22.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55610 req_id = 614b01f3-a0a4-4ed6-8c01-443bcc651e04 response_code = 200 uri = /network-bootstore-config
29762024-11-01T07:02:25.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29772024-11-01T07:02:25.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29782024-11-01T07:02:25.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29792024-11-01T07:02:25.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29802024-11-01T07:02:26.401ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65406
29812024-11-01T07:02:26.401ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65406 req_id = bdf49f8c-7a5d-4775-ac6d-0e82cb7db9f0 response_code = 200 uri = /baseboard
29822024-11-01T07:02:27.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29832024-11-01T07:02:27.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29842024-11-01T07:02:27.778ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29852024-11-01T07:02:27.779ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29862024-11-01T07:02:28.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29872024-11-01T07:02:29.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29882024-11-01T07:02:29.300ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29892024-11-01T07:02:29.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29902024-11-01T07:02:29.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29912024-11-01T07:02:29.302ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29922024-11-01T07:02:29.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29932024-11-01T07:02:29.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29942024-11-01T07:02:29.311ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29952024-11-01T07:02:29.312ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29962024-11-01T07:02:35.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29972024-11-01T07:02:35.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29982024-11-01T07:02:35.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
29992024-11-01T07:02:35.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30002024-11-01T07:02:37.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30012024-11-01T07:02:37.275ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30022024-11-01T07:02:37.781ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30032024-11-01T07:02:37.782ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30042024-11-01T07:02:38.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30052024-11-01T07:02:39.248ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30062024-11-01T07:02:39.302ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30072024-11-01T07:02:39.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30082024-11-01T07:02:39.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30092024-11-01T07:02:39.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30102024-11-01T07:02:39.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30112024-11-01T07:02:39.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30122024-11-01T07:02:39.314ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30132024-11-01T07:02:39.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30142024-11-01T07:02:45.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30152024-11-01T07:02:45.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30162024-11-01T07:02:45.296ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30172024-11-01T07:02:45.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30182024-11-01T07:02:47.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30192024-11-01T07:02:47.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30202024-11-01T07:02:47.784ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30212024-11-01T07:02:47.784ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30222024-11-01T07:02:48.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30232024-11-01T07:02:49.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30242024-11-01T07:02:49.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30252024-11-01T07:02:49.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30262024-11-01T07:02:49.317ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30272024-11-01T07:02:49.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30282024-11-01T07:02:49.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30292024-11-01T07:02:49.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30302024-11-01T07:02:49.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30312024-11-01T07:02:49.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30322024-11-01T07:02:51.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37776
30332024-11-01T07:02:51.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37776 req_id = ff5a0833-cc1a-4516-a007-d2bff4ba5967 response_code = 200 uri = /v2p
30342024-11-01T07:02:51.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55766
30352024-11-01T07:02:51.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55766 req_id = c31e368c-953c-429b-b6b6-019571610796 response_code = 200 uri = /vpc-routes
30362024-11-01T07:02:51.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
30372024-11-01T07:02:51.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55766 req_id = eb0bce3a-22c9-4000-9ace-65bac3b6e0f8 response_code = 204 uri = /eip-gateways
30382024-11-01T07:02:51.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55766 req_id = 5fa6186b-41e7-4377-8e4e-78ba7eafe3a3 response_code = 204 uri = /vpc-routes
30392024-11-01T07:02:51.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37433
30402024-11-01T07:02:51.566ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
30412024-11-01T07:02:51.609ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
30422024-11-01T07:02:51.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37433 req_id = 0b6c3d28-e9b7-4f57-8252-5a7c5c3d2656 response_code = 204 uri = /switch-ports
30432024-11-01T07:02:51.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37433 req_id = d8885f0e-6be9-4116-966b-c2207a44e7dd response_code = 200 uri = /network-bootstore-config
30442024-11-01T07:02:51.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47080
30452024-11-01T07:02:51.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47080 req_id = 329fb9f8-250c-462c-be86-c9fc304138ac response_code = 200 uri = /vpc-routes
30462024-11-01T07:02:52.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
30472024-11-01T07:02:52.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47080 req_id = 2623df34-4aba-4746-bf6b-f03e1630b7d3 response_code = 204 uri = /eip-gateways
30482024-11-01T07:02:52.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47080 req_id = 5e2b5687-d28b-4cc7-b1bd-b5a6935763fa response_code = 204 uri = /vpc-routes
30492024-11-01T07:02:52.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38656
30502024-11-01T07:02:52.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38656 req_id = 04a3fa46-4f1a-4ddd-b79e-8f35ee029ee0 response_code = 200 uri = /v2p
30512024-11-01T07:02:52.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41453
30522024-11-01T07:02:52.062ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
30532024-11-01T07:02:52.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
30542024-11-01T07:02:52.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41453 req_id = 92081ff8-c429-4e4c-bfb2-1afb8814ec26 response_code = 204 uri = /switch-ports
30552024-11-01T07:02:52.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41453 req_id = 444d2c6e-496a-4205-835a-2af5c7be49d1 response_code = 200 uri = /network-bootstore-config
30562024-11-01T07:02:52.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62629
30572024-11-01T07:02:52.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62629 req_id = 636ee84d-4343-4aed-99a2-5722af6d1305 response_code = 200 uri = /vpc-routes
30582024-11-01T07:02:52.262ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
30592024-11-01T07:02:52.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62629 req_id = 9fc14171-627e-45b1-9612-febf74bc166b response_code = 204 uri = /eip-gateways
30602024-11-01T07:02:52.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62629 req_id = fe492532-1fb7-440d-ae09-627f6de27ec6 response_code = 204 uri = /vpc-routes
30612024-11-01T07:02:52.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49573
30622024-11-01T07:02:52.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49573 req_id = 61847701-86bd-4e89-bf92-42c40b46f8c5 response_code = 200 uri = /v2p
30632024-11-01T07:02:52.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33723
30642024-11-01T07:02:52.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
30652024-11-01T07:02:52.466ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
30662024-11-01T07:02:52.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33723 req_id = d8edd059-0294-483d-861f-274176ba89a3 response_code = 204 uri = /switch-ports
30672024-11-01T07:02:52.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33723 req_id = 9d8b56b5-bebb-419e-a6fa-5c55f4436570 response_code = 200 uri = /network-bootstore-config
30682024-11-01T07:02:55.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30692024-11-01T07:02:55.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30702024-11-01T07:02:55.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30712024-11-01T07:02:55.300ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30722024-11-01T07:02:56.436ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34844
30732024-11-01T07:02:56.436ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34844 req_id = 8effbb80-39c2-486d-8cc9-3eb9943405e6 response_code = 200 uri = /baseboard
30742024-11-01T07:02:57.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30752024-11-01T07:02:57.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30762024-11-01T07:02:57.786ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30772024-11-01T07:02:57.787ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30782024-11-01T07:02:58.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62767
30792024-11-01T07:02:58.059ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4126360))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-96de6c1cd2c", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: b4c268c5-5efb-4c80-bb4f-37c15a9c9288, read_only_parent: Some(Volume { block_size: 512, id: 089c95c2-fbca-4b72-b3f0-c24199389fd3, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 4cc219b4-c395-4e5d-964e-341438c842c9, key: Some("9DInPzOygsaLm3jQMcBC7Hz+XC52Gg2zuDB0Y5kiY+0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b4c268c5-5efb-4c80-bb4f-37c15a9c9288, key: Some("HuMyr6Fo6L43ol/pEtlb3F8SeAiMMA60MdWbM7YnR8E="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::19]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-96de6c1cd2c" }] }), cloud_init_bytes: Some(..) } instance_id = 9c522447-c323-4c4d-8899-3761095da66e metadata = InstanceMetadata { silo_id: e8cbb51f-1c20-4e39-a503-2a8ec246f231, project_id: 98dfb7b1-e626-4490-90c8-053b25a82b56 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-01T07:02:58.054944153Z }
30802024-11-01T07:02:58.059ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 9c522447-c323-4c4d-8899-3761095da66e migration_id = None propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
30812024-11-01T07:02:58.059ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 9c522447-c323-4c4d-8899-3761095da66e migration_id = None propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4126360))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55a4cbaf-9cb4-488d-881e-3b9e53255a38, kind: Instance { id: 9c522447-c323-4c4d-8899-3761095da66e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4126360), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-96de6c1cd2c", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: b4c268c5-5efb-4c80-bb4f-37c15a9c9288, read_only_parent: Some(Volume { block_size: 512, id: 089c95c2-fbca-4b72-b3f0-c24199389fd3, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 4cc219b4-c395-4e5d-964e-341438c842c9, key: Some("9DInPzOygsaLm3jQMcBC7Hz+XC52Gg2zuDB0Y5kiY+0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b4c268c5-5efb-4c80-bb4f-37c15a9c9288, key: Some("HuMyr6Fo6L43ol/pEtlb3F8SeAiMMA60MdWbM7YnR8E="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::19]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-96de6c1cd2c" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-01T07:02:58.054944153Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30822024-11-01T07:02:58.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5962 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62767 req_id = 52e11249-f0eb-475c-8bbf-2d33903ebd3e response_code = 200 uri = /vmms/4aff54ac-09f0-4dfa-8a64-a5440928c664
30832024-11-01T07:02:58.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35403
30842024-11-01T07:02:58.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35403 req_id = 88158c0f-7c9b-431c-88a1-8cc103f4df92 response_code = 200 uri = /v2p
30852024-11-01T07:02:58.158ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4126360) }
30862024-11-01T07:02:58.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35403 req_id = 224bbe17-a288-433a-84d7-64fde5ec1b8f response_code = 204 uri = /v2p
30872024-11-01T07:02:58.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46752
30882024-11-01T07:02:58.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46752 req_id = b33538cf-3efa-48c2-b601-a2baf3f82837 response_code = 200 uri = /vmms/4aff54ac-09f0-4dfa-8a64-a5440928c664/state
30892024-11-01T07:02:58.179ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4126360 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30902024-11-01T07:02:58.179ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30912024-11-01T07:02:58.225ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664 file = illumos-utils/src/zone.rs:325 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
30922024-11-01T07:02:58.250ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664 file = illumos-utils/src/zone.rs:363 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
30932024-11-01T07:02:58.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57127
30942024-11-01T07:02:58.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57127 req_id = e13c37c3-ccdb-4492-94b9-ac0f9232d399 response_code = 200 uri = /vpc-routes
30952024-11-01T07:02:58.273ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {55a4cbaf-9cb4-488d-881e-3b9e53255a38: {10.151.1.175: {a43554e5-4920-49e5-b651-a558578ca12e}, 10.151.1.176: {a43554e5-4920-49e5-b651-a558578ca12e}}} }
30962024-11-01T07:02:58.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30972024-11-01T07:02:59.255ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30982024-11-01T07:02:59.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
30992024-11-01T07:02:59.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31002024-11-01T07:02:59.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31012024-11-01T07:02:59.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31022024-11-01T07:02:59.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31032024-11-01T07:02:59.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31042024-11-01T07:02:59.323ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31052024-11-01T07:02:59.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31062024-11-01T07:02:59.696ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31072024-11-01T07:02:59.697ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31082024-11-01T07:02:59.879ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 37.49717ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31092024-11-01T07:02:59.929ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 94.023707ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31102024-11-01T07:03:00.044ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 281.358191ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31112024-11-01T07:03:00.343ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 490.12335ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31122024-11-01T07:03:00.852ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 897.717476ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31132024-11-01T07:03:01.765ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 1.490347619s file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31142024-11-01T07:03:03.269ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 1.181443421s file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31152024-11-01T07:03:04.465ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 609.93526ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 zone = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31162024-11-01T07:03:05.105ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664 file = sled-agent/src/instance.rs:1787 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31172024-11-01T07:03:05.118ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 65.644829ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31182024-11-01T07:03:05.196ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 66.687107ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31192024-11-01T07:03:05.273ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664") failed: Property not found. retry in 276.231481ms file = illumos-utils/src/svc.rs:36 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31202024-11-01T07:03:05.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31212024-11-01T07:03:05.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31222024-11-01T07:03:05.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31232024-11-01T07:03:05.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31242024-11-01T07:03:05.563ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31252024-11-01T07:03:05.601ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31262024-11-01T07:03:05.739ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31272024-11-01T07:03:05.740ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31282024-11-01T07:03:05.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7468174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57127 req_id = e205b962-d545-4420-b379-8b76f1b1579e response_code = 204 uri = /eip-gateways
31292024-11-01T07:03:05.742ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-01T07:03:05.741356961Z } file = sled-agent/src/instance.rs:780 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31302024-11-01T07:03:05.742ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9c522447-c323-4c4d-8899-3761095da66e new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T07:03:05.741356961Z } propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31312024-11-01T07:03:05.742ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T07:03:05.741356961Z }, migration_in: None, migration_out: None }
31322024-11-01T07:03:05.797ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-01T07:03:05.797068852Z } file = sled-agent/src/instance.rs:780 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31332024-11-01T07:03:05.797ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9c522447-c323-4c4d-8899-3761095da66e new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T07:03:05.797068852Z } propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31342024-11-01T07:03:05.797ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T07:03:05.797068852Z }, migration_in: None, migration_out: None }
31352024-11-01T07:03:05.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57127 req_id = 1ff263db-30db-46cd-b2a0-179ac92553d1 response_code = 204 uri = /vpc-routes
31362024-11-01T07:03:07.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31372024-11-01T07:03:07.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31382024-11-01T07:03:07.787ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31392024-11-01T07:03:07.788ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31402024-11-01T07:03:08.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31412024-11-01T07:03:09.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31422024-11-01T07:03:09.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31432024-11-01T07:03:09.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31442024-11-01T07:03:09.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31452024-11-01T07:03:09.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31462024-11-01T07:03:09.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31472024-11-01T07:03:09.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31482024-11-01T07:03:09.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31492024-11-01T07:03:09.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31502024-11-01T07:03:15.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31512024-11-01T07:03:15.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31522024-11-01T07:03:15.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31532024-11-01T07:03:15.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31542024-11-01T07:03:15.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54948
31552024-11-01T07:03:15.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 501 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54948 req_id = f0ae4a9f-04cc-44b3-93b2-57940909d773 response_code = 200 uri = /vmms/4aff54ac-09f0-4dfa-8a64-a5440928c664/state
31562024-11-01T07:03:15.726ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-01T07:03:15.726444187Z } file = sled-agent/src/instance.rs:780 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31572024-11-01T07:03:15.726ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9c522447-c323-4c4d-8899-3761095da66e new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T07:03:15.726444187Z } propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31582024-11-01T07:03:15.726ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T07:03:15.726444187Z }, migration_in: None, migration_out: None }
31592024-11-01T07:03:15.741ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-01T07:03:15.741138147Z } file = sled-agent/src/instance.rs:780 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31602024-11-01T07:03:15.741ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9c522447-c323-4c4d-8899-3761095da66e new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-01T07:03:15.741138147Z } propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31612024-11-01T07:03:15.741ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31622024-11-01T07:03:15.741ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
31632024-11-01T07:03:15.741ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10676718953237762589 n_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31642024-11-01T07:03:15.741ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 4468595191656694829 n_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31652024-11-01T07:03:15.741ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
31662024-11-01T07:03:15.741ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/b5d27312-460e-427e-9a8a-bfde3f16d714/debug/bundle/zone", "/pool/int/fc28d189-ac13-484c-bb99-0ea04c623f0c/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/dd270633-6bc2-4925-9cc8-0d8cbe344d5c/crypt/debug", "/pool/ext/9c422399-4aa1-4979-b10e-d7bb51cc9ea8/crypt/debug", "/pool/ext/ef152924-a63c-43bb-a571-2ff3b6071747/crypt/debug", "/pool/ext/97f3e142-6bfb-426e-92d5-9fe2f0689aa2/crypt/debug", "/pool/ext/fd147d75-70ba-4f51-bd1a-94ba187fecc6/crypt/debug", "/pool/ext/d3002782-e4e6-4eb6-90d0-05203f9776aa/crypt/debug", "/pool/ext/e1a43d6a-09dc-44d6-9940-8b3aa07b0871/crypt/debug", "/pool/ext/415a68a1-91bd-446b-a587-2b70d19e26e9/crypt/debug", "/pool/ext/950a040d-5cd2-426c-8ac9-53395920b1aa/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664
31672024-11-01T07:03:16.394ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664", bundle_id: 7aedbc18-8042-4d53-8537-5f2ad3b285ad }, time_created: 2024-11-01T07:03:15.742747512Z, version: 0, cause: TerminatedInstance }
31682024-11-01T07:03:16.394ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_4aff54ac-09f0-4dfa-8a64-a5440928c664 file = sled-agent/src/instance.rs:1032 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31692024-11-01T07:03:17.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31702024-11-01T07:03:17.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31712024-11-01T07:03:17.791ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31722024-11-01T07:03:17.791ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31732024-11-01T07:03:18.147ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31742024-11-01T07:03:18.166ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(4126360), kind: System }
31752024-11-01T07:03:18.166ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(4126360), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31762024-11-01T07:03:18.166ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T07:03:18.166577823Z }, migration_in: None, migration_out: None }
31772024-11-01T07:03:18.194ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T07:03:18.166577823Z }, migration_in: None, migration_out: None }
31782024-11-01T07:03:18.198ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 9c522447-c323-4c4d-8899-3761095da66e propolis_id = 4aff54ac-09f0-4dfa-8a64-a5440928c664
31792024-11-01T07:03:18.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31802024-11-01T07:03:18.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60636
31812024-11-01T07:03:18.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60636 req_id = e8a64cc8-a0e7-4b79-a0e0-7e750658bca3 response_code = 200 uri = /vpc-routes
31822024-11-01T07:03:18.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
31832024-11-01T07:03:18.680ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31842024-11-01T07:03:18.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60636 req_id = d052c1a0-cdc6-4455-839e-ee7db65e24f4 response_code = 204 uri = /eip-gateways
31852024-11-01T07:03:18.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60636 req_id = 26d5f589-ddcb-4a8a-b7f2-da027967f9d2 response_code = 204 uri = /vpc-routes
31862024-11-01T07:03:18.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59526
31872024-11-01T07:03:18.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59526 req_id = a93c6f46-3eea-4fa7-81a5-24f79553552b response_code = 200 uri = /v2p
31882024-11-01T07:03:19.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42193
31892024-11-01T07:03:19.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42193 req_id = f7ca3dfc-d937-4e41-8268-af9d0d88e4f2 response_code = 200 uri = /v2p
31902024-11-01T07:03:19.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55577
31912024-11-01T07:03:19.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55577 req_id = bbdc24c8-ab0b-4290-b0f7-e3c271e3379a response_code = 200 uri = /vpc-routes
31922024-11-01T07:03:19.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
31932024-11-01T07:03:19.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55577 req_id = 31be190c-063b-47f2-ad48-500cc65e150f response_code = 204 uri = /eip-gateways
31942024-11-01T07:03:19.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55577 req_id = f0c8e6a9-84e7-4356-b8f8-3e427e9abfc3 response_code = 204 uri = /vpc-routes
31952024-11-01T07:03:19.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31962024-11-01T07:03:19.312ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31972024-11-01T07:03:19.323ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31982024-11-01T07:03:19.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
31992024-11-01T07:03:19.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
32002024-11-01T07:03:19.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
32012024-11-01T07:03:19.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
32022024-11-01T07:03:19.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
32032024-11-01T07:03:19.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 66656a2e-362d-410c-b905-3979762845f4
32042024-11-01T07:03:19.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39757
32052024-11-01T07:03:19.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39757 req_id = 530dd345-6223-4009-9017-3dc29f3711b9 response_code = 200 uri = /vpc-routes
32062024-11-01T07:03:19.779ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
32072024-11-01T07:03:19.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39757 req_id = 9e816404-1d7e-427c-9d46-11635fd0b2ec response_code = 204 uri = /eip-gateways
32082024-11-01T07:03:19.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39757 req_id = 28e8dd60-7123-49f2-af5a-49d8c13a479e response_code = 204 uri = /vpc-routes
32092024-11-01T07:03:21.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43500
32102024-11-01T07:03:21.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43500 req_id = a87640c9-5395-461c-90b1-67a0e8f5f14d response_code = 200 uri = /v2p
32112024-11-01T07:03:21.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35504
32122024-11-01T07:03:21.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35504 req_id = 4e383cd5-0ea8-4a31-bbc1-baa4008644f5 response_code = 200 uri = /vpc-routes
32132024-11-01T07:03:21.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
32142024-11-01T07:03:21.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35504 req_id = da41ff47-aae8-4d9e-9413-a665acd868c6 response_code = 204 uri = /eip-gateways
32152024-11-01T07:03:21.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59854
32162024-11-01T07:03:21.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
32172024-11-01T07:03:21.929ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
32182024-11-01T07:03:22.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59854 req_id = 18a1823e-eff6-4f35-bd03-ceb47d77187f response_code = 204 uri = /switch-ports
32192024-11-01T07:03:22.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35504 req_id = 95b547b2-334f-435c-90a7-01685af1cb6b response_code = 204 uri = /vpc-routes
32202024-11-01T07:03:22.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59854 req_id = 91111e6d-f161-45af-87fd-f2b7f5eacde0 response_code = 200 uri = /network-bootstore-config
32212024-11-01T07:03:22.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46524
32222024-11-01T07:03:22.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46524 req_id = c56963b4-15a3-455f-9baa-c2755023eb7a response_code = 200 uri = /vpc-routes
32232024-11-01T07:03:22.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
32242024-11-01T07:03:22.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46524 req_id = d44a9d13-7f65-4ea4-a0e9-aa5e9307d581 response_code = 204 uri = /eip-gateways
32252024-11-01T07:03:22.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46524 req_id = f227a70f-a12c-4751-bc99-f894946eada6 response_code = 204 uri = /vpc-routes
32262024-11-01T07:03:22.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34566
32272024-11-01T07:03:22.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34566 req_id = 8aba7a5e-a961-4de9-8b45-fdc125ab5869 response_code = 200 uri = /v2p
32282024-11-01T07:03:22.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48335
32292024-11-01T07:03:22.389ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
32302024-11-01T07:03:22.430ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
32312024-11-01T07:03:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123743 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48335 req_id = bf043f31-76d3-471b-bb00-3b29e0219d24 response_code = 204 uri = /switch-ports
32322024-11-01T07:03:22.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35015
32332024-11-01T07:03:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35015 req_id = 41a95644-5b8c-438c-ae5e-7a8c04d71bb6 response_code = 200 uri = /vpc-routes
32342024-11-01T07:03:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48335 req_id = 0f5f92e9-68f7-49b5-826f-f850d09af69d response_code = 200 uri = /network-bootstore-config
32352024-11-01T07:03:22.568ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 66656a2e-362d-410c-b905-3979762845f4 values = ExternalIpGatewayMap { mappings: {} }
32362024-11-01T07:03:22.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35015 req_id = c9cfa909-42b7-4d97-9acb-76a7b5059dea response_code = 204 uri = /eip-gateways
32372024-11-01T07:03:22.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35015 req_id = 471622bc-d21f-4795-a880-6fbc4e88383a response_code = 204 uri = /vpc-routes
32382024-11-01T07:03:22.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40820
32392024-11-01T07:03:22.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40820 req_id = 6ae3d21f-aa91-4268-bd9c-fab5c0c77cc3 response_code = 200 uri = /v2p
32402024-11-01T07:03:22.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50226
32412024-11-01T07:03:22.816ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
32422024-11-01T07:03:22.864ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
32432024-11-01T07:03:22.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50226 req_id = 8f869e69-a0bc-450f-9e83-6da90859ca91 response_code = 204 uri = /switch-ports
32442024-11-01T07:03:22.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50226 req_id = 71cb8f73-cd74-428d-8bf0-7fd87e7ef07a response_code = 200 uri = /network-bootstore-config